Sep 10 14:26:05.329378 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 14:26:05.329522 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 14:26:05.329612 ip-10-0-137-62 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 14:26:05.330060 ip-10-0-137-62 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 14:26:15.444344 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 14:26:15.444364 ip-10-0-137-62 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 23f88566a4c3429ebfec5a87b6f364a0 --
Sep 10 14:28:04.034905 ip-10-0-137-62 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 14:28:04.411301 ip-10-0-137-62 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:28:04.411301 ip-10-0-137-62 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 14:28:04.411301 ip-10-0-137-62 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:28:04.411301 ip-10-0-137-62 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 14:28:04.411301 ip-10-0-137-62 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:28:04.412011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.411925    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 14:28:04.415482 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415466    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415484    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415488    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415491    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415495    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415498    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415501    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415504    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415507    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415510    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415513    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415515    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415519    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:28:04.415519 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415525    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415530    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415534    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415537    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415539    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415542    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415545    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415547    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415550    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415553    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415555    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415558    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415560    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415576    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415581    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415585    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415590    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415593    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415596    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:28:04.415840 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415599    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415602    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415605    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415607    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415610    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415612    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415615    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415617    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415620    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415622    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415625    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415627    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415630    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415632    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415636    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415640    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415643    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415645    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415648    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415651    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:28:04.416450 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415653    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415656    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415659    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415661    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415665    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415668    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415670    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415672    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415675    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415677    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415680    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415682    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415685    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415687    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415690    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415692    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415695    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415698    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415700    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415703    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:28:04.417145 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415705    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415708    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415711    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415713    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415716    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415718    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415722    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415728    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415731    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415735    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415739    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415742    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415745    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415749    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415752    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415754    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415758    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415760    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415763    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:28:04.417653 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415765    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415768    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415771    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415774    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415776    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415779    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415781    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.415784    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417776    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417788    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417793    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417796    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417799    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417802    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417804    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417807    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417810    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417812    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417815    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:28:04.418158 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417820    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417824    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417827    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417829    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417832    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417836    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417839    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417841    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417844    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417847    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417850    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417852    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417855    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417858    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417860    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417864    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417867    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417869    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417872    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:28:04.418633 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417874    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417889    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417892    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417895    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417898    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417901    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417903    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417906    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417909    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417912    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417914    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417917    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417920    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417923    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417926    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417929    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417932    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417934    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417937    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417940    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:28:04.419132 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417943    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417946    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417949    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417952    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417955    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417958    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417962    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417966    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417969    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417972    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417975    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417977    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417980    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417983    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417986    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417988    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417991    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417993    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417996    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.417998    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:28:04.419637 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418001    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418004    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418007    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418010    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418012    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418015    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418018    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418020    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418023    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418027    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418030    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418035    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418038    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418042    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418044    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418047    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418049    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418052    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418055    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418057    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:28:04.420134 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418060    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418062    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418065    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418068    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418070    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418073    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418075    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418077    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418080    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418448    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418453    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418456    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418459    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418461    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418467    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418469    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418472    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418474    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418477    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:28:04.420651 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418480    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418483    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418486    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418488    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418491    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418494    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418498    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418500    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418503    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418506    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418508    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418511    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418513    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418516    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418518    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418521    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418523    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418526    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418528    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418531    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:28:04.421107 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418534    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418536    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418539    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418541    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418544    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418546    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418548    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418552    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418555    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418557    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418560    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418577    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418580    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418583    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418585    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418588    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418591    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418594    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418596    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418600    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:28:04.421595 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418602    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418605    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418608    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418610    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418613    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418615    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418618    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418621    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418623    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418626    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418628    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418631    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418633    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418636    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418639    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418642    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418645    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418647    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418650    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418653    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:28:04.422078 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418656    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418659    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418663    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418667    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418670    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418674    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418677    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418680    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418684    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418687    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418690    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418693    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418696    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418700    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418703    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418706    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418709    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418711    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:28:04.422578 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418714    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418717    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418720    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418722    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418725    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418728    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418730    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418733    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418735    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418738    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.418741    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418829    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418885    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418894    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418899    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418903    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418907    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418911    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418915    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418919    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418922    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418926    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 14:28:04.423050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418930    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418933    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418936    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418939    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418942    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418945    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418948    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418952    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418955    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418958    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418961    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418964    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418973    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418976    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418979    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418982    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418985    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418988    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418991    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418994    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.418997    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419001    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419004    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419007    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419010    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 14:28:04.423626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419013    2561 flags.go:64] FLAG: --enable-server="true"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419016    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419021    2561 flags.go:64] FLAG: --event-burst="100"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419026    2561 flags.go:64] FLAG: --event-qps="50"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419029    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419031    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419035    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419038    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419041    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419044    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419047    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419050    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419054    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419057    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419060    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419063    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419066    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419069    2561 flags.go:64] FLAG: --feature-gates=""
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419077    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419080    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419083    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419086    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419089    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419092    2561 flags.go:64] FLAG: --help="false"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419095    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.424232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419098    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419101    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419104    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419108    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419111    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419114    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419117    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419120    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419122    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419125    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419130    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419133    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419136    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419139    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419142    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419145    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419148    2561 flags.go:64] FLAG: --lock-file=""
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419151    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419154    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419157    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419162    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419166    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419169    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 14:28:04.424877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419172    2561 flags.go:64] FLAG: --logging-format="text"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419175    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419178    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419181    2561 flags.go:64] FLAG: --manifest-url=""
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419185    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419189    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419192    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419197    2561 flags.go:64] FLAG: --max-pods="110"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419199    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419202    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419205    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419208    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419211    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419214    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419217    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419225    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419229    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419231    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419234    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419238    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419243    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419246    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419249    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419252    2561 flags.go:64] FLAG: --port="10250"
Sep 10 14:28:04.425454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419255    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419258    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b51847a4b23b9f08"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419261    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419264    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419266    2561 flags.go:64] FLAG: --register-node="true"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419269    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419273    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419281    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419284    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419287    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419290    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419293    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419298    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419301    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419304    2561 flags.go:64] FLAG: --runonce="false"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419321    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419326    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419329    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419333    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419336    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419339    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419342    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419345    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419348    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419351    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 14:28:04.426095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419354    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419357    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419360    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419363    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419365    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419371    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419373    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419376    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419380    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419383    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419386    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419389    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419392    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419395    2561 flags.go:64] FLAG: --v="2"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419399    2561 flags.go:64] FLAG: --version="false"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419403    2561 flags.go:64] FLAG: --vmodule=""
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419407    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.419410    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419530    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419537    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419541    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419545    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419547    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:28:04.426835 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419550    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419553    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419556    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419560    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419578    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419582    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419587    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419591    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419594    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419596    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419599    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419601    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419604    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419607    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419609    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419611    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419614    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419617    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419619    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419622    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:28:04.427395 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419624    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419628    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419631    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419633    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419636    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419640    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419643    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419646    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419650    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419653    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419656    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419658    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419661    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419663    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419666    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419668    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419671    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419674    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419676    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419679    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:28:04.427913 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419682    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419684    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419687    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419689    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419692    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419694    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419697    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419699    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419702    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419704    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419707    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419709    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419712    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419714    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419717    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419719    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419722    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419725    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419728    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419731    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:28:04.428417 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419734    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419737    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419739    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419742    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419744    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419747    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419751    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419753    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419756    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419758    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419761    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419763    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419766    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419770    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419774    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419776    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419779    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419782    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419785    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:28:04.428923 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419788    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419791    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419793    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419796    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419798    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419801    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419804    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419806    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419809    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419811    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419815    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419818    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419821    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419825    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:28:04.429374 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.419828    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.420341    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.428464    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.428482    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.428503    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.428510    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428579    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428585    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428588    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428591    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428595    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428597    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428600    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428603    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428606    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:28:04.429826 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428609    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428612    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428615    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428619    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428623    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428626    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428629    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428631    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428634    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428637    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428640    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428642    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428645    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428648    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428650    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428653    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428655    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428658    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428661    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428663    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:28:04.430241 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428667    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428670    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428673    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428678    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428681    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428684    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428687    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428690    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428692    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428695    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428698    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428700    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428703    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428705    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428708    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428711    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428713    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428716    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428718    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428721    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:28:04.430754 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428724    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428726    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428728    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428731    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428734    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428736    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428739    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428741    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428744    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428746    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428748    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428751    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428755    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428766    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428769    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428771    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428774    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428777    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428779    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428782    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:28:04.431240 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428784    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428787    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428789    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428792    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428795    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428797    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428801    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428803    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428807    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428811    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428815    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428817    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428820    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428822    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428825    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428827    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428831    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428833    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428836    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:28:04.431758 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428839    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428842    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428844    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428847    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428849    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428852    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428855    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428858    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428860    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428864    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428866    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.428872    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428994    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.428998    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429001    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429004    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:28:04.432214 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429007    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429010    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429012    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429015    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429017    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429020    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429022    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429025    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429028    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429031    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429033    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429036    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429039    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429041    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429044    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429046    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429049    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429052    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429054    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429056    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:28:04.432627 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429059    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429061    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429064    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429067    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429070    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429073    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429076    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429079    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429082    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429085    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429087    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429090    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429092    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429095    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429097    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429100    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429102    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429105    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429108    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:28:04.433121 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429111    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429113    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429116    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429118    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429121    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429124    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429126    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429129    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429131    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429134    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429136    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429140    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429142    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429145    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429147    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429150    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429153    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429155    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429158    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:28:04.433584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429162    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429165    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429168    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429171    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429174    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429177    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429179    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429182    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429184    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429187    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429190    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429194    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429197    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429200    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429203    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429205    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429208    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429210    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429213    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429216    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:28:04.434049 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429218    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429221    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429224    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429226    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429228    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429231    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429233    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429236    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429239    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429241    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429244    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429247    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429250    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429253    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429255    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429257    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:28:04.434530 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:04.429260    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:28:04.435021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.429265    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:28:04.435021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.429376    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 14:28:04.435021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.431303    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 14:28:04.435021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.432046    2561 server.go:1019] "Starting client certificate rotation"
Sep 10 14:28:04.435021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.432150    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:28:04.435021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.432184    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:28:04.435021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.434742    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:28:04.438392 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.438373    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:28:04.450105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.450085    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 10 14:28:04.453062 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.453044    2561 log.go:25] "Validated CRI v1 image API"
Sep 10 14:28:04.453913 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.453896    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 14:28:04.458911 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.458882    2561 fs.go:135] Filesystem UUIDs: map[3c4a9195-664a-44db-8361-b323353a8d69:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e38342e6-4bc8-40a2-b47f-e3f1b9b595f1:/dev/nvme0n1p4]
Sep 10 14:28:04.458995 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.458909    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 14:28:04.460742 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.460723    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:28:04.464001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.463893    2561 manager.go:216] Machine: {Timestamp:2026-09-10 14:28:04.462621786 +0000 UTC m=+0.317126371 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108612 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f3da010db22a4784837885300e41 SystemUUID:ec26f3da-010d-b22a-4784-837885300e41 BootID:23f88566-a4c3-429e-bfec-5a87b6f364a0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:d5:a3:92:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:d5:a3:92:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:15:72:3d:2b:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 14:28:04.464001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.464001    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 14:28:04.464101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.464087    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 14:28:04.467721 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.467690    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 14:28:04.467896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.467725    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 14:28:04.468486 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.468475    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 14:28:04.468525 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.468488    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 14:28:04.468525 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.468506    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:28:04.469055 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.469044    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:28:04.469981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.469971    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 14:28:04.473397 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473382    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:28:04.473536 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473526    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 14:28:04.473579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473560    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 14:28:04.473609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473584    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 14:28:04.473609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473605    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 14:28:04.473665 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473616    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 10 14:28:04.473665 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473625    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 14:28:04.474004 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.473990    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:28:04.474051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.474012    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:28:04.477212 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.477193    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 14:28:04.479838 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.479821    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 14:28:04.479905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.479856    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 14:28:04.480899 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480887    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 14:28:04.480941 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480905    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 14:28:04.480941 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480912    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 14:28:04.480941 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480922    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 14:28:04.480941 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480935    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 14:28:04.481046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480944    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 14:28:04.481046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480958    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 14:28:04.481046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480963    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 14:28:04.481046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480973    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 14:28:04.481046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480979    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 14:28:04.481046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.480998    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 14:28:04.481046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.481004    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 14:28:04.481718 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.481709    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 14:28:04.481718 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.481718    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 14:28:04.484330 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.484311    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42tzh"
Sep 10 14:28:04.484626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.484611    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 14:28:04.485235 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.485213    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 14:28:04.485235 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.485218    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 14:28:04.485663 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.485651    2561 server.go:1268] "Started kubelet"
Sep 10 14:28:04.485760 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.485712    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 14:28:04.485875 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.485825    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 14:28:04.485930 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.485894    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 14:28:04.489231 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.489208    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 14:28:04.490133 ip-10-0-137-62 systemd[1]: Started Kubernetes Kubelet.
Sep 10 14:28:04.491026 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.491007    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 14:28:04.491385 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.491302    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 14:28:04.492266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.492251    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42tzh"
Sep 10 14:28:04.496169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.496151    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 14:28:04.496259 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.496179    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 14:28:04.497160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.495928    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-62.ec2.internal.18d3fbefd5018413  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-62.ec2.internal,UID:ip-10-0-137-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-62.ec2.internal,},FirstTimestamp:2026-09-10 14:28:04.485620755 +0000 UTC m=+0.340125342,LastTimestamp:2026-09-10 14:28:04.485620755 +0000 UTC m=+0.340125342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-62.ec2.internal,}"
Sep 10 14:28:04.497160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.497139    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:04.497783 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.497764    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 14:28:04.497927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.497907    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 14:28:04.498016 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.497763    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 14:28:04.498069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.498036    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 14:28:04.498069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.498046    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 14:28:04.499414 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.499398    2561 factory.go:55] Registering systemd factory
Sep 10 14:28:04.499511 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.499503    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 10 14:28:04.499945 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.499916    2561 factory.go:153] Registering CRI-O factory
Sep 10 14:28:04.499945 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.499936    2561 factory.go:223] Registration of the crio container factory successfully
Sep 10 14:28:04.500045 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.500007    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 14:28:04.500045 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.500029    2561 factory.go:103] Registering Raw factory
Sep 10 14:28:04.500045 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.500044    2561 manager.go:1196] Started watching for new ooms in manager
Sep 10 14:28:04.500425 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.500412    2561 manager.go:349] Starting recovery of all containers
Sep 10 14:28:04.508539 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.508515    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:28:04.508874 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.508822    2561 manager.go:354] Recovery completed
Sep 10 14:28:04.510876 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.510854    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.513110 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.513096    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:28:04.514921 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.514905    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:28:04.514981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.514939    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:28:04.514981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.514955    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:28:04.515753 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.515597    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:28:04.515826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.515623    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 14:28:04.515876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.515825    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 14:28:04.515876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.515847    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:28:04.516516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.516493    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:28:04.516586 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.516537    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:28:04.516586 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.516554    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:28:04.517125 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.517112    2561 policy_none.go:49] "None policy: Start"
Sep 10 14:28:04.517185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.517130    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 14:28:04.517185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.517143    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 14:28:04.518209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.518195    2561 policy_none.go:47] "Start"
Sep 10 14:28:04.543233 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.543216    2561 manager.go:337] "Starting Device Plugin manager"
Sep 10 14:28:04.543323 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.543254    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 14:28:04.543323 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.543264    2561 server.go:87] "Starting device plugin registration server"
Sep 10 14:28:04.543553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.543537    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 14:28:04.543670 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.543552    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 14:28:04.543771 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.543744    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 14:28:04.543926 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.543913    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 14:28:04.543926 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.543927    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 14:28:04.544689 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.544665    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 14:28:04.544772 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.544724    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:04.595604 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.595521    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 14:28:04.596862 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.596783    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 14:28:04.596862 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.596830    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 14:28:04.596862 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.596856    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 14:28:04.597041 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.596960    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 14:28:04.598932 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.598909    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:28:04.644644 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.644604    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:28:04.645772 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.645755    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:28:04.645859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.645787    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:28:04.645859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.645800    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:28:04.645859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.645828    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.654970 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.654952    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.655020 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.654975    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-62.ec2.internal\": node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:04.664558 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.664471    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:04.698020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.697988    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"]
Sep 10 14:28:04.698172 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.698156    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:28:04.698296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.698279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00f35f8448defbf79fcceaf599e379ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"00f35f8448defbf79fcceaf599e379ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.698407 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.698303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00f35f8448defbf79fcceaf599e379ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"00f35f8448defbf79fcceaf599e379ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.699101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.699084    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:28:04.699198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.699120    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:28:04.699198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.699137    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:28:04.700381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.700366    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:28:04.700518 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.700486    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.700583 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.700523    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:28:04.701164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.701138    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:28:04.701164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.701167    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:28:04.701277 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.701176    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:28:04.701277 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.701145    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:28:04.701277 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.701240    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:28:04.701277 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.701251    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:28:04.702234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.702218    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.702282 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.702250    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:28:04.702956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.702936    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:28:04.703032 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.702972    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:28:04.703032 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.702985    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:28:04.727233 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.727211    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.731523 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.731507    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.765341 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.765311    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:04.799047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.799015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00f35f8448defbf79fcceaf599e379ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"00f35f8448defbf79fcceaf599e379ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.799186 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.799055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00f35f8448defbf79fcceaf599e379ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"00f35f8448defbf79fcceaf599e379ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.799186 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.799065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00f35f8448defbf79fcceaf599e379ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"00f35f8448defbf79fcceaf599e379ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.799186 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.799101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00f35f8448defbf79fcceaf599e379ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"00f35f8448defbf79fcceaf599e379ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.865896 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.865864    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:04.899184 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.899154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c7e12d74c055eb868a423b92fc23f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"b2c7e12d74c055eb868a423b92fc23f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:04.966512 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:04.966434    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:04.999968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:04.999939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c7e12d74c055eb868a423b92fc23f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"b2c7e12d74c055eb868a423b92fc23f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:05.000035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:05.000007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c7e12d74c055eb868a423b92fc23f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"b2c7e12d74c055eb868a423b92fc23f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:05.030103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:05.030076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:05.035196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:05.035178    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:06.457197 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:06.457163    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:06.557676 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:06.557625    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:06.658270 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:06.658179    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:06.758734 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:06.758676    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:06.822241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.822211    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 14:28:06.822780 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.822366    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 14:28:06.822780 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.822414    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 14:28:06.858855 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:06.858810    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:06.875022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.874992    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:28:06.885638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.885609    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 14:23:05 +0000 UTC" deadline="2028-03-25 05:12:45.65357112 +0000 UTC"
Sep 10 14:28:06.885638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.885637    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13478h44m38.76793716s"
Sep 10 14:28:06.894179 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:06.894142    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f35f8448defbf79fcceaf599e379ae.slice/crio-17ffdfafbf692eb380c2af33ecaa5949324633c9b2bb5f45533ce318b53b319c WatchSource:0}: Error finding container 17ffdfafbf692eb380c2af33ecaa5949324633c9b2bb5f45533ce318b53b319c: Status 404 returned error can't find the container with id 17ffdfafbf692eb380c2af33ecaa5949324633c9b2bb5f45533ce318b53b319c
Sep 10 14:28:06.894475 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:06.894452    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c7e12d74c055eb868a423b92fc23f4.slice/crio-64ccb19f8cc7d0ef76d0613c04e27c00384d2bff759d2a4a1f73695e935976f4 WatchSource:0}: Error finding container 64ccb19f8cc7d0ef76d0613c04e27c00384d2bff759d2a4a1f73695e935976f4: Status 404 returned error can't find the container with id 64ccb19f8cc7d0ef76d0613c04e27c00384d2bff759d2a4a1f73695e935976f4
Sep 10 14:28:06.899904 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.899887    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:28:06.959169 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:06.959078    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:06.990698 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.990640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"b2c7e12d74c055eb868a423b92fc23f4","Type":"ContainerStarted","Data":"64ccb19f8cc7d0ef76d0613c04e27c00384d2bff759d2a4a1f73695e935976f4"}
Sep 10 14:28:06.991714 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:06.991668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"00f35f8448defbf79fcceaf599e379ae","Type":"ContainerStarted","Data":"17ffdfafbf692eb380c2af33ecaa5949324633c9b2bb5f45533ce318b53b319c"}
Sep 10 14:28:07.059941 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:07.059911    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:07.160458 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:07.160428    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Sep 10 14:28:07.214748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.214653    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:28:07.288210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.288173    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:07.299445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.299415    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:28:07.300399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.300379    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Sep 10 14:28:07.308974 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.308950    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:28:07.743172 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.743140    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:28:07.864889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.864856    2561 apiserver.go:52] "Watching apiserver"
Sep 10 14:28:07.873426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.873399    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 14:28:07.873777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.873746    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-6sq6k","openshift-network-diagnostics/network-check-target-zcz7q","openshift-network-operator/iptables-alerter-zk58x","openshift-ovn-kubernetes/ovnkube-node-gpb5t","kube-system/global-pull-secret-syncer-8l7m8","kube-system/konnectivity-agent-7bbgl","kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bn7hw","openshift-image-registry/node-ca-dxkvg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal","openshift-multus/multus-8k6mr","openshift-multus/multus-additional-cni-plugins-r5t6h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv","openshift-dns/node-resolver-lkcmg"]
Sep 10 14:28:07.875219 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.875201    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.876408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.876381    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:07.876524 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:07.876496    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:07.877513 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.877493    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:07.877690 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.877669    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 14:28:07.877871 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.877854    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 14:28:07.877965 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.877949    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j5sdw\""
Sep 10 14:28:07.878337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.878315    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 14:28:07.879001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.878980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.880135 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.879953    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:28:07.880135 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.880073    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:07.880289 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:07.880132    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:07.880289 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.880245    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 14:28:07.880289 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.880268    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dqdvj\""
Sep 10 14:28:07.880524 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.880507    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 14:28:07.881204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.881188    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:07.881715 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.881683    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6lsg4\""
Sep 10 14:28:07.881839 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.881774    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 14:28:07.881839 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.881825    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 14:28:07.881945 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.881851    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 14:28:07.882420 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.882399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:07.882501 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:07.882461    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:07.882595 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.882574    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 14:28:07.882677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.882603    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 14:28:07.882677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.882617    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 14:28:07.883580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.883563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rph4b\""
Sep 10 14:28:07.884398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.883753    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 14:28:07.884398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.883912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.884398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.884136    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 14:28:07.885221 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.885202    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:07.885981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.885957    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bzc9v\""
Sep 10 14:28:07.886180 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.886156    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 14:28:07.886286 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.886164    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:28:07.886739 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.886719    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:07.887292 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.886945    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 14:28:07.887455 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.887438    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 14:28:07.887499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.887467    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75k5q\""
Sep 10 14:28:07.887759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.887741    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 14:28:07.887850 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.887766    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 14:28:07.889087 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.888521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.889693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.889212    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 14:28:07.889693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.889217    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 14:28:07.889693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.889262    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-njw85\""
Sep 10 14:28:07.890544 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.890527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:07.891015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.890992    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 14:28:07.891741 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.891696    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 14:28:07.892659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.892643    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4qd9v\""
Sep 10 14:28:07.893213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.893144    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 14:28:07.893812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.893794    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 14:28:07.894579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.894557    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 14:28:07.896162 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.895958    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 14:28:07.896953 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.896934    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zp2m4\""
Sep 10 14:28:07.897649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-socket-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.897769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-tuned\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.897769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170e4494-461c-449c-9566-264229206c49-multus-daemon-config\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.897769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:07.897769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcms6\" (UniqueName: \"kubernetes.io/projected/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-kube-api-access-pcms6\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.897956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-kubernetes\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.897956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4abca780-21a2-427b-88de-fd7860f80cc6-serviceca\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:07.897956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170e4494-461c-449c-9566-264229206c49-cni-binary-copy\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.897956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-node-log\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.897956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-device-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.897956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-etc-kubernetes\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.897961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-run-netns\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.898241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898092    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a2302ed9-18a1-4e02-913d-ff52ce1e809a-kubelet-config\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:07.898335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdjx\" (UniqueName: \"kubernetes.io/projected/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-kube-api-access-4hdjx\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:07.898335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbsr8\" (UniqueName: \"kubernetes.io/projected/ef3af520-4a0f-4115-8fa8-888e462c251b-kube-api-access-mbsr8\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.898335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptx48\" (UniqueName: \"kubernetes.io/projected/06815116-8ee8-46d9-bec0-0d14f714e090-kube-api-access-ptx48\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:07.898476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-socket-dir-parent\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-netns\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-cni-bin\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-kubelet\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.898476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-cni-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-cni-multus\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-hostroot\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898532    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcsdj\" (UniqueName: \"kubernetes.io/projected/170e4494-461c-449c-9566-264229206c49-kube-api-access-bcsdj\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-systemd-units\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-env-overrides\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpshk\" (UniqueName: \"kubernetes.io/projected/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-kube-api-access-kpshk\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:07.898677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898679    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-ovn\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898745    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-var-lib-kubelet\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06815116-8ee8-46d9-bec0-0d14f714e090-hosts-file\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898777    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06815116-8ee8-46d9-bec0-0d14f714e090-tmp-dir\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-conf-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-var-lib-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-log-socket\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-etc-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovnkube-script-lib\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-registration-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysctl-d\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z24cn\" (UniqueName: \"kubernetes.io/projected/4abca780-21a2-427b-88de-fd7860f80cc6-kube-api-access-z24cn\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.898989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-k8s-cni-cncf-io\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.899050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-sys\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovn-node-metrics-cert\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-cni-netd\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-sys-fs\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqc8v\" (UniqueName: \"kubernetes.io/projected/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-kube-api-access-sqc8v\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-lib-modules\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-cnibin\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a2302ed9-18a1-4e02-913d-ff52ce1e809a-dbus\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-multus-certs\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a241bd0-29b2-4619-9b3b-e0cf15f5bc80-agent-certs\") pod \"konnectivity-agent-7bbgl\" (UID: \"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80\") " pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4abca780-21a2-427b-88de-fd7860f80cc6-host\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899364    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-systemd\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-run\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-iptables-alerter-script\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:07.899789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-host-slash\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-slash\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-cni-bin\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysconfig\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-host\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-systemd\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovnkube-config\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a241bd0-29b2-4619-9b3b-e0cf15f5bc80-konnectivity-ca\") pod \"konnectivity-agent-7bbgl\" (UID: \"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80\") " pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-modprobe-d\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysctl-conf\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef3af520-4a0f-4115-8fa8-888e462c251b-tmp\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.899972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-system-cni-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.900006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-kubelet\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:07.900502 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.900027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:07.916685 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.916661    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x2gfl"
Sep 10 14:28:07.924281 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.924259    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x2gfl"
Sep 10 14:28:07.989716 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:07.989685    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 14:28:08.000934 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.000860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.000934 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.000899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsl6x\" (UniqueName: \"kubernetes.io/projected/92c4d9ff-163b-4310-841a-2657d78f963b-kube-api-access-lsl6x\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.001123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.000951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovn-node-metrics-cert\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.001123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-cni-netd\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.001123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001089    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-cni-netd\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.001123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-sys-fs\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqc8v\" (UniqueName: \"kubernetes.io/projected/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-kube-api-access-sqc8v\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-lib-modules\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-cnibin\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a2302ed9-18a1-4e02-913d-ff52ce1e809a-dbus\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-multus-certs\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-sys-fs\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a241bd0-29b2-4619-9b3b-e0cf15f5bc80-agent-certs\") pod \"konnectivity-agent-7bbgl\" (UID: \"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80\") " pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4abca780-21a2-427b-88de-fd7860f80cc6-host\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:08.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-multus-certs\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001345    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-lib-modules\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4abca780-21a2-427b-88de-fd7860f80cc6-host\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001408    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a2302ed9-18a1-4e02-913d-ff52ce1e809a-dbus\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-systemd\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-cnibin\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001445    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-systemd\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-run\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.001728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.001602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-run\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.002272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-iptables-alerter-script\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:08.002272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-host-slash\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:08.002272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-slash\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.002272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-cni-bin\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.002272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysconfig\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.002489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-host\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.002578 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-systemd\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.002578 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovnkube-config\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-slash\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-host-slash\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-host\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-systemd\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-iptables-alerter-script\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a241bd0-29b2-4619-9b3b-e0cf15f5bc80-konnectivity-ca\") pod \"konnectivity-agent-7bbgl\" (UID: \"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80\") " pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysconfig\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-modprobe-d\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.002692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysctl-conf\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef3af520-4a0f-4115-8fa8-888e462c251b-tmp\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-system-cni-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-modprobe-d\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-kubelet\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-socket-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-tuned\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170e4494-461c-449c-9566-264229206c49-multus-daemon-config\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002878    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysctl-conf\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-cni-bin\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcms6\" (UniqueName: \"kubernetes.io/projected/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-kube-api-access-pcms6\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-kubernetes\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.002979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4abca780-21a2-427b-88de-fd7860f80cc6-serviceca\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170e4494-461c-449c-9566-264229206c49-cni-binary-copy\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-system-cni-dir\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.003143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003064    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-node-log\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-device-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-etc-kubernetes\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-run-netns\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a2302ed9-18a1-4e02-913d-ff52ce1e809a-kubelet-config\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-system-cni-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a241bd0-29b2-4619-9b3b-e0cf15f5bc80-konnectivity-ca\") pod \"konnectivity-agent-7bbgl\" (UID: \"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80\") " pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003211    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdjx\" (UniqueName: \"kubernetes.io/projected/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-kube-api-access-4hdjx\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbsr8\" (UniqueName: \"kubernetes.io/projected/ef3af520-4a0f-4115-8fa8-888e462c251b-kube-api-access-mbsr8\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptx48\" (UniqueName: \"kubernetes.io/projected/06815116-8ee8-46d9-bec0-0d14f714e090-kube-api-access-ptx48\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-node-log\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-socket-dir-parent\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-netns\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-cni-bin\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-kubelet\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-cni-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.003927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-etc-kubernetes\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-cni-multus\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003909    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-hostroot\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcsdj\" (UniqueName: \"kubernetes.io/projected/170e4494-461c-449c-9566-264229206c49-kube-api-access-bcsdj\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003966    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-kubernetes\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-systemd-units\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.004027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-systemd-units\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.004071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-hostroot\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003444    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a2302ed9-18a1-4e02-913d-ff52ce1e809a-kubelet-config\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovnkube-config\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-socket-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.004621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170e4494-461c-449c-9566-264229206c49-cni-binary-copy\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.004801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.003362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-cni-bin\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.005354 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.004867    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-kubelet\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.005354 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.005113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-device-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.005354 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.005222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-kubelet\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.005751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.005686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.005853 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.005820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-env-overrides\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.005853 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.005833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-tuned\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.005954 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.005932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpshk\" (UniqueName: \"kubernetes.io/projected/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-kube-api-access-kpshk\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:08.006127 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-ovn\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.006181 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.006242 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-run-netns\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.006291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-socket-dir-parent\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.006341 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.006515 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-var-lib-kubelet\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.006572 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-cni-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.006572 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-env-overrides\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.006670 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006577    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.006740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-run-ovn\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.006848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06815116-8ee8-46d9-bec0-0d14f714e090-hosts-file\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:08.006848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006773    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4abca780-21a2-427b-88de-fd7860f80cc6-serviceca\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:08.006848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006823    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-var-lib-kubelet\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.006986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006844    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06815116-8ee8-46d9-bec0-0d14f714e090-hosts-file\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:08.006986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-netns\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.006986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06815116-8ee8-46d9-bec0-0d14f714e090-tmp-dir\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:08.006986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-conf-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.006986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/170e4494-461c-449c-9566-264229206c49-multus-daemon-config\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-var-lib-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-multus-conf-dir\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.006975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-var-lib-cni-multus\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007059    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-log-socket\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-var-lib-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-cnibin\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-log-socket\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-etc-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.007216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovnkube-script-lib\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-registration-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007278    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-etc-openvswitch\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007343    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-registration-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.007431    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysctl-d\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z24cn\" (UniqueName: \"kubernetes.io/projected/4abca780-21a2-427b-88de-fd7860f80cc6-kube-api-access-z24cn\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a241bd0-29b2-4619-9b3b-e0cf15f5bc80-agent-certs\") pod \"konnectivity-agent-7bbgl\" (UID: \"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80\") " pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.007579    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret podName:a2302ed9-18a1-4e02-913d-ff52ce1e809a nodeName:}" failed. No retries permitted until 2026-09-10 14:28:08.507530151 +0000 UTC m=+2.971896652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret") pod "global-pull-secret-syncer-8l7m8" (UID: "a2302ed9-18a1-4e02-913d-ff52ce1e809a") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:08.007625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-k8s-cni-cncf-io\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007674    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-etc-sysctl-d\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007732    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovnkube-script-lib\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-sys\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/170e4494-461c-449c-9566-264229206c49-host-run-k8s-cni-cncf-io\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.007846    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.007899    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef3af520-4a0f-4115-8fa8-888e462c251b-sys\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.008101 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.007910    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs podName:d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac nodeName:}" failed. No retries permitted until 2026-09-10 14:28:08.50789304 +0000 UTC m=+2.972259545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs") pod "network-metrics-daemon-6sq6k" (UID: "d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:08.008594 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.008336    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:28:08.008594 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.008353    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:28:08.008594 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.008372    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x4j for pod openshift-network-diagnostics/network-check-target-zcz7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:08.008594 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.008436    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j podName:fac44fb0-b5fc-45bb-99f1-b4557bd5c67f nodeName:}" failed. No retries permitted until 2026-09-10 14:28:08.508413047 +0000 UTC m=+2.972779564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-69x4j" (UniqueName: "kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j") pod "network-check-target-zcz7q" (UID: "fac44fb0-b5fc-45bb-99f1-b4557bd5c67f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:08.009645 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.009621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06815116-8ee8-46d9-bec0-0d14f714e090-tmp-dir\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:08.009987 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.009966    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef3af520-4a0f-4115-8fa8-888e462c251b-tmp\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.010063 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.010037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-ovn-node-metrics-cert\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.012987 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.012960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqc8v\" (UniqueName: \"kubernetes.io/projected/eab8660b-bbeb-4fde-b0fb-82a60b35b6a4-kube-api-access-sqc8v\") pod \"aws-ebs-csi-driver-node-m47pv\" (UID: \"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.013102 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.013061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbsr8\" (UniqueName: \"kubernetes.io/projected/ef3af520-4a0f-4115-8fa8-888e462c251b-kube-api-access-mbsr8\") pod \"tuned-bn7hw\" (UID: \"ef3af520-4a0f-4115-8fa8-888e462c251b\") " pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.013353 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.013334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcms6\" (UniqueName: \"kubernetes.io/projected/d4ec1b44-ea72-4158-ad63-9a46cc7ab118-kube-api-access-pcms6\") pod \"ovnkube-node-gpb5t\" (UID: \"d4ec1b44-ea72-4158-ad63-9a46cc7ab118\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.013427 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.013339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptx48\" (UniqueName: \"kubernetes.io/projected/06815116-8ee8-46d9-bec0-0d14f714e090-kube-api-access-ptx48\") pod \"node-resolver-lkcmg\" (UID: \"06815116-8ee8-46d9-bec0-0d14f714e090\") " pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:08.014086 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.014060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcsdj\" (UniqueName: \"kubernetes.io/projected/170e4494-461c-449c-9566-264229206c49-kube-api-access-bcsdj\") pod \"multus-8k6mr\" (UID: \"170e4494-461c-449c-9566-264229206c49\") " pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.014646 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.014620    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpshk\" (UniqueName: \"kubernetes.io/projected/0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b-kube-api-access-kpshk\") pod \"iptables-alerter-zk58x\" (UID: \"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b\") " pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:08.015020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.015002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdjx\" (UniqueName: \"kubernetes.io/projected/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-kube-api-access-4hdjx\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:08.017787 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.017766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z24cn\" (UniqueName: \"kubernetes.io/projected/4abca780-21a2-427b-88de-fd7860f80cc6-kube-api-access-z24cn\") pod \"node-ca-dxkvg\" (UID: \"4abca780-21a2-427b-88de-fd7860f80cc6\") " pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:08.108687 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.108687 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.108687 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsl6x\" (UniqueName: \"kubernetes.io/projected/92c4d9ff-163b-4310-841a-2657d78f963b-kube-api-access-lsl6x\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108720    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-system-cni-dir\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-cnibin\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-system-cni-dir\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.108959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92c4d9ff-163b-4310-841a-2657d78f963b-cnibin\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109382 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.109341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109718 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.109443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.109901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.109881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92c4d9ff-163b-4310-841a-2657d78f963b-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.119605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.119584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsl6x\" (UniqueName: \"kubernetes.io/projected/92c4d9ff-163b-4310-841a-2657d78f963b-kube-api-access-lsl6x\") pod \"multus-additional-cni-plugins-r5t6h\" (UID: \"92c4d9ff-163b-4310-841a-2657d78f963b\") " pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.187693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.187662    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv"
Sep 10 14:28:08.198114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.198089    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zk58x"
Sep 10 14:28:08.206468 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.206446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:08.211669 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.211648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:08.218290 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.218269    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bn7hw"
Sep 10 14:28:08.224695 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.224675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dxkvg"
Sep 10 14:28:08.232421 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.232394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lkcmg"
Sep 10 14:28:08.241008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.240987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8k6mr"
Sep 10 14:28:08.246618 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.246595    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5t6h"
Sep 10 14:28:08.286296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.286233    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:28:08.512573 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.512538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:08.512794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.512598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:08.512794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.512622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:08.512794 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512714    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:28:08.512794 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512744    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:28:08.512794 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512759    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x4j for pod openshift-network-diagnostics/network-check-target-zcz7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:08.512794 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512764    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:08.513081 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512764    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:08.513081 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512821    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j podName:fac44fb0-b5fc-45bb-99f1-b4557bd5c67f nodeName:}" failed. No retries permitted until 2026-09-10 14:28:09.512801319 +0000 UTC m=+3.977167836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x4j" (UniqueName: "kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j") pod "network-check-target-zcz7q" (UID: "fac44fb0-b5fc-45bb-99f1-b4557bd5c67f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:08.513081 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512849    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret podName:a2302ed9-18a1-4e02-913d-ff52ce1e809a nodeName:}" failed. No retries permitted until 2026-09-10 14:28:09.512832983 +0000 UTC m=+3.977199487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret") pod "global-pull-secret-syncer-8l7m8" (UID: "a2302ed9-18a1-4e02-913d-ff52ce1e809a") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:08.513081 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:08.512866    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs podName:d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac nodeName:}" failed. No retries permitted until 2026-09-10 14:28:09.512859471 +0000 UTC m=+3.977225976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs") pod "network-metrics-daemon-6sq6k" (UID: "d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:08.763858 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.763819    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab8660b_bbeb_4fde_b0fb_82a60b35b6a4.slice/crio-9b34fe534080c24f6ae19842f0656e8c33fdace26fb148fce4e619320dbce035 WatchSource:0}: Error finding container 9b34fe534080c24f6ae19842f0656e8c33fdace26fb148fce4e619320dbce035: Status 404 returned error can't find the container with id 9b34fe534080c24f6ae19842f0656e8c33fdace26fb148fce4e619320dbce035
Sep 10 14:28:08.764863 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.764810    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c4d9ff_163b_4310_841a_2657d78f963b.slice/crio-6f85dbe380073bbfc21de6fc815157f3394b61a3ca968e04b81fd94ee50889cf WatchSource:0}: Error finding container 6f85dbe380073bbfc21de6fc815157f3394b61a3ca968e04b81fd94ee50889cf: Status 404 returned error can't find the container with id 6f85dbe380073bbfc21de6fc815157f3394b61a3ca968e04b81fd94ee50889cf
Sep 10 14:28:08.768223 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.768194    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ec1b44_ea72_4158_ad63_9a46cc7ab118.slice/crio-417675d30b3f4ad65de083e18eea8725118a642a266c2b9c80d634414c2246b5 WatchSource:0}: Error finding container 417675d30b3f4ad65de083e18eea8725118a642a266c2b9c80d634414c2246b5: Status 404 returned error can't find the container with id 417675d30b3f4ad65de083e18eea8725118a642a266c2b9c80d634414c2246b5
Sep 10 14:28:08.769041 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.769013    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06815116_8ee8_46d9_bec0_0d14f714e090.slice/crio-aa26aaf7744a82464c1b092df9333b5985981c81234951c4e2886dc593b4c343 WatchSource:0}: Error finding container aa26aaf7744a82464c1b092df9333b5985981c81234951c4e2886dc593b4c343: Status 404 returned error can't find the container with id aa26aaf7744a82464c1b092df9333b5985981c81234951c4e2886dc593b4c343
Sep 10 14:28:08.770968 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.770943    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a241bd0_29b2_4619_9b3b_e0cf15f5bc80.slice/crio-a9192682c6fb09000d5ad0dbc3cc7fd217538878ce446d3033ac407ec2854f7b WatchSource:0}: Error finding container a9192682c6fb09000d5ad0dbc3cc7fd217538878ce446d3033ac407ec2854f7b: Status 404 returned error can't find the container with id a9192682c6fb09000d5ad0dbc3cc7fd217538878ce446d3033ac407ec2854f7b
Sep 10 14:28:08.772996 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.772586    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3af520_4a0f_4115_8fa8_888e462c251b.slice/crio-9cf9cce6cf59a02d2bda62bdaeaaf66be9fd9a2a989ba5394ed3f467fc302107 WatchSource:0}: Error finding container 9cf9cce6cf59a02d2bda62bdaeaaf66be9fd9a2a989ba5394ed3f467fc302107: Status 404 returned error can't find the container with id 9cf9cce6cf59a02d2bda62bdaeaaf66be9fd9a2a989ba5394ed3f467fc302107
Sep 10 14:28:08.773373 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.773279    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170e4494_461c_449c_9566_264229206c49.slice/crio-f17108beeb2cef533b0a819e0bb3895bdfc7c5af06df5e684d20ce17bb81ab21 WatchSource:0}: Error finding container f17108beeb2cef533b0a819e0bb3895bdfc7c5af06df5e684d20ce17bb81ab21: Status 404 returned error can't find the container with id f17108beeb2cef533b0a819e0bb3895bdfc7c5af06df5e684d20ce17bb81ab21
Sep 10 14:28:08.774070 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.773868    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abca780_21a2_427b_88de_fd7860f80cc6.slice/crio-6d3a3dfe4838fed86528a46619221db54607c9de298e11ea809277d6fcacccea WatchSource:0}: Error finding container 6d3a3dfe4838fed86528a46619221db54607c9de298e11ea809277d6fcacccea: Status 404 returned error can't find the container with id 6d3a3dfe4838fed86528a46619221db54607c9de298e11ea809277d6fcacccea
Sep 10 14:28:08.776469 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:28:08.776442    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc3a8a2_3687_43b2_ac42_f8ad0fb27b4b.slice/crio-582a9609f550899850ad86343393f24b827233d9dead21f68b1514d07d643c68 WatchSource:0}: Error finding container 582a9609f550899850ad86343393f24b827233d9dead21f68b1514d07d643c68: Status 404 returned error can't find the container with id 582a9609f550899850ad86343393f24b827233d9dead21f68b1514d07d643c68
Sep 10 14:28:08.926341 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.926110    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:23:07 +0000 UTC" deadline="2028-03-14 06:06:02.826953097 +0000 UTC"
Sep 10 14:28:08.926341 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.926329    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13215h37m53.900628755s"
Sep 10 14:28:08.996826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.996795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"b2c7e12d74c055eb868a423b92fc23f4","Type":"ContainerStarted","Data":"1fd0e1c99c2032d6a9d46bb0a18b42c56032f4a20c995ddebc0856065431ae0f"}
Sep 10 14:28:08.999721 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:08.999651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zk58x" event={"ID":"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b","Type":"ContainerStarted","Data":"582a9609f550899850ad86343393f24b827233d9dead21f68b1514d07d643c68"}
Sep 10 14:28:09.000816 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.000790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dxkvg" event={"ID":"4abca780-21a2-427b-88de-fd7860f80cc6","Type":"ContainerStarted","Data":"6d3a3dfe4838fed86528a46619221db54607c9de298e11ea809277d6fcacccea"}
Sep 10 14:28:09.001840 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.001813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8k6mr" event={"ID":"170e4494-461c-449c-9566-264229206c49","Type":"ContainerStarted","Data":"f17108beeb2cef533b0a819e0bb3895bdfc7c5af06df5e684d20ce17bb81ab21"}
Sep 10 14:28:09.002919 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.002896    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bn7hw" event={"ID":"ef3af520-4a0f-4115-8fa8-888e462c251b","Type":"ContainerStarted","Data":"9cf9cce6cf59a02d2bda62bdaeaaf66be9fd9a2a989ba5394ed3f467fc302107"}
Sep 10 14:28:09.003975 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.003955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lkcmg" event={"ID":"06815116-8ee8-46d9-bec0-0d14f714e090","Type":"ContainerStarted","Data":"aa26aaf7744a82464c1b092df9333b5985981c81234951c4e2886dc593b4c343"}
Sep 10 14:28:09.004950 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.004931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"417675d30b3f4ad65de083e18eea8725118a642a266c2b9c80d634414c2246b5"}
Sep 10 14:28:09.006146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.006121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7bbgl" event={"ID":"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80","Type":"ContainerStarted","Data":"a9192682c6fb09000d5ad0dbc3cc7fd217538878ce446d3033ac407ec2854f7b"}
Sep 10 14:28:09.007369 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.007346    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerStarted","Data":"6f85dbe380073bbfc21de6fc815157f3394b61a3ca968e04b81fd94ee50889cf"}
Sep 10 14:28:09.008361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.008341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv" event={"ID":"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4","Type":"ContainerStarted","Data":"9b34fe534080c24f6ae19842f0656e8c33fdace26fb148fce4e619320dbce035"}
Sep 10 14:28:09.010225 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.010180    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" podStartSLOduration=2.01016685 podStartE2EDuration="2.01016685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:09.010156171 +0000 UTC m=+3.474522693" watchObservedRunningTime="2026-09-10 14:28:09.01016685 +0000 UTC m=+3.474533372"
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.520395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.520446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.520493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520644    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520662    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520677    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x4j for pod openshift-network-diagnostics/network-check-target-zcz7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520749    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j podName:fac44fb0-b5fc-45bb-99f1-b4557bd5c67f nodeName:}" failed. No retries permitted until 2026-09-10 14:28:11.520730063 +0000 UTC m=+5.985096568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x4j" (UniqueName: "kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j") pod "network-check-target-zcz7q" (UID: "fac44fb0-b5fc-45bb-99f1-b4557bd5c67f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520821    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520858    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret podName:a2302ed9-18a1-4e02-913d-ff52ce1e809a nodeName:}" failed. No retries permitted until 2026-09-10 14:28:11.520847323 +0000 UTC m=+5.985213829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret") pod "global-pull-secret-syncer-8l7m8" (UID: "a2302ed9-18a1-4e02-913d-ff52ce1e809a") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520907    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:09.521306 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.520935    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs podName:d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac nodeName:}" failed. No retries permitted until 2026-09-10 14:28:11.520925221 +0000 UTC m=+5.985291724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs") pod "network-metrics-daemon-6sq6k" (UID: "d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:09.927393 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.927180    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:23:07 +0000 UTC" deadline="2028-06-17 16:56:39.211199882 +0000 UTC"
Sep 10 14:28:09.927393 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.927246    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15506h28m29.28395953s"
Sep 10 14:28:09.991679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.990825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:09.991679 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.990949    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:09.991679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.991358    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:09.991679 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.991467    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:09.991679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:09.991535    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:09.991679 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:09.991602    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:10.035274 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:10.034751    2561 generic.go:356] "Generic (PLEG): container finished" podID="00f35f8448defbf79fcceaf599e379ae" containerID="7c4e5410ee96c2cbd81902ef325589e994fb560bb21831fe1791300610aa1fe2" exitCode=0
Sep 10 14:28:10.035274 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:10.034838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"00f35f8448defbf79fcceaf599e379ae","Type":"ContainerDied","Data":"7c4e5410ee96c2cbd81902ef325589e994fb560bb21831fe1791300610aa1fe2"}
Sep 10 14:28:11.045100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:11.044122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"00f35f8448defbf79fcceaf599e379ae","Type":"ContainerStarted","Data":"39b354a9a6955d80704cb2386c39bf048b27ee7a38a76737355e86957c478134"}
Sep 10 14:28:11.538131 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:11.538041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:11.538131 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:11.538121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:11.538358 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:11.538158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:11.538358 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538297    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:11.538463 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538362    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs podName:d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac nodeName:}" failed. No retries permitted until 2026-09-10 14:28:15.538341055 +0000 UTC m=+10.002707559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs") pod "network-metrics-daemon-6sq6k" (UID: "d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:11.538819 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538797    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:28:11.538939 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538827    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:28:11.538939 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538839    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x4j for pod openshift-network-diagnostics/network-check-target-zcz7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:11.538939 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538886    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j podName:fac44fb0-b5fc-45bb-99f1-b4557bd5c67f nodeName:}" failed. No retries permitted until 2026-09-10 14:28:15.53887068 +0000 UTC m=+10.003237194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x4j" (UniqueName: "kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j") pod "network-check-target-zcz7q" (UID: "fac44fb0-b5fc-45bb-99f1-b4557bd5c67f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:11.539093 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538945    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:11.539093 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.538980    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret podName:a2302ed9-18a1-4e02-913d-ff52ce1e809a nodeName:}" failed. No retries permitted until 2026-09-10 14:28:15.538969638 +0000 UTC m=+10.003336153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret") pod "global-pull-secret-syncer-8l7m8" (UID: "a2302ed9-18a1-4e02-913d-ff52ce1e809a") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:11.987892 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:11.987804    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:11.988086 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:11.988066    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:11.988183 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.988159    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:11.988244 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:11.988222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:11.988322 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.988299    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:11.988382 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:11.987938    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:13.988181 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:13.987825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:13.988181 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:13.987961    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:13.988181 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:13.987825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:13.988181 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:13.988068    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:13.988181 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:13.988092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:13.988181 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:13.988152    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:15.573397 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:15.573357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:15.573860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:15.573434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:15.573860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:15.573463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:15.573860 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.573587    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:15.573860 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.573651    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs podName:d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac nodeName:}" failed. No retries permitted until 2026-09-10 14:28:23.573630787 +0000 UTC m=+18.037997290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs") pod "network-metrics-daemon-6sq6k" (UID: "d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:15.574193 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.574174    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:28:15.574260 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.574201    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:28:15.574260 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.574213    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x4j for pod openshift-network-diagnostics/network-check-target-zcz7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:15.574260 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.574259    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j podName:fac44fb0-b5fc-45bb-99f1-b4557bd5c67f nodeName:}" failed. No retries permitted until 2026-09-10 14:28:23.574242918 +0000 UTC m=+18.038609423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x4j" (UniqueName: "kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j") pod "network-check-target-zcz7q" (UID: "fac44fb0-b5fc-45bb-99f1-b4557bd5c67f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:15.574466 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.574306    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:15.574466 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.574336    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret podName:a2302ed9-18a1-4e02-913d-ff52ce1e809a nodeName:}" failed. No retries permitted until 2026-09-10 14:28:23.574325667 +0000 UTC m=+18.038692173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret") pod "global-pull-secret-syncer-8l7m8" (UID: "a2302ed9-18a1-4e02-913d-ff52ce1e809a") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:15.991105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:15.991016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:15.991261 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.991159    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:15.991371 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:15.991343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:15.991509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:15.991399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:15.991509 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.991484    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:15.991631 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:15.991555    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:17.987510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:17.987474    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:17.987510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:17.987500    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:17.988058 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:17.987499    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:17.988058 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:17.987608    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:17.988058 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:17.987697    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:17.988058 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:17.987812    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:19.988250 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:19.988213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:19.988759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:19.988216    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:19.988759 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:19.988352    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:19.988759 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:19.988444    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:19.988759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:19.988225    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:19.988759 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:19.988552    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:21.988033 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:21.987999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:21.988469 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:21.988000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:21.988469 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:21.988126    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:21.988469 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:21.988209    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:21.988469 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:21.988000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:21.988469 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:21.988360    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:23.638608 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:23.638567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:23.638608 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:23.638613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:23.638666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638754    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638786    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638805    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638821    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638825    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret podName:a2302ed9-18a1-4e02-913d-ff52ce1e809a nodeName:}" failed. No retries permitted until 2026-09-10 14:28:39.638808214 +0000 UTC m=+34.103174718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret") pod "global-pull-secret-syncer-8l7m8" (UID: "a2302ed9-18a1-4e02-913d-ff52ce1e809a") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638832    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x4j for pod openshift-network-diagnostics/network-check-target-zcz7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638845    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs podName:d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac nodeName:}" failed. No retries permitted until 2026-09-10 14:28:39.638834078 +0000 UTC m=+34.103200578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs") pod "network-metrics-daemon-6sq6k" (UID: "d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:23.639160 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.638873    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j podName:fac44fb0-b5fc-45bb-99f1-b4557bd5c67f nodeName:}" failed. No retries permitted until 2026-09-10 14:28:39.638858845 +0000 UTC m=+34.103225365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x4j" (UniqueName: "kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j") pod "network-check-target-zcz7q" (UID: "fac44fb0-b5fc-45bb-99f1-b4557bd5c67f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:23.987526 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:23.987447    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:23.987526 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:23.987491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:23.987526 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:23.987447    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:23.987842 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.987590    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:23.987842 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.987793    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:23.987939 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:23.987883    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:25.987920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:25.987876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:25.988352 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:25.987990    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:25.988352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:25.988001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:25.988352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:25.988034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:25.988352 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:25.988088    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:25.988352 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:25.988210    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:27.079679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.079478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dxkvg" event={"ID":"4abca780-21a2-427b-88de-fd7860f80cc6","Type":"ContainerStarted","Data":"e9907de75b41dd9069ad4b1213d16e9c96360fb5674f8a0c5c07788b3d37ba7d"}
Sep 10 14:28:27.081186 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.081155    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8k6mr" event={"ID":"170e4494-461c-449c-9566-264229206c49","Type":"ContainerStarted","Data":"391e1dee84209ca8e135ca170db19df5030382b73b9fa6f6957d63199c9bb64e"}
Sep 10 14:28:27.082984 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.082929    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bn7hw" event={"ID":"ef3af520-4a0f-4115-8fa8-888e462c251b","Type":"ContainerStarted","Data":"79ef7b63136cc67b99edad9c5875df83109e8384ef608eece57bcac5bf2c2938"}
Sep 10 14:28:27.084683 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.084658    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lkcmg" event={"ID":"06815116-8ee8-46d9-bec0-0d14f714e090","Type":"ContainerStarted","Data":"69dc19e8c023a92def5a45d0a7018936283f3c3728022c471fae075f27c628d2"}
Sep 10 14:28:27.089679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.089649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"8173c62aa3133c60432b2636e4965f67aa058d934cfe03952af7cbbaff084449"}
Sep 10 14:28:27.089808 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.089767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"a56924d48a59544e9854d7a820524cbbd1bea77a0ad08b72859bcea29a716087"}
Sep 10 14:28:27.089881 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.089822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"fa94c65adc539aa951b2336d1dc60c50caf561c8091c6d445b8f56dc459ed2eb"}
Sep 10 14:28:27.089881 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.089872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"f350fef8b4add0550a5b649c8ebf9ad83ade7454d01567a8ae292a5fcc7cee9b"}
Sep 10 14:28:27.091425 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.091405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7bbgl" event={"ID":"4a241bd0-29b2-4619-9b3b-e0cf15f5bc80","Type":"ContainerStarted","Data":"5f89c48ee8d3df7959ecb8ce51f8baecd7792051242012365389576bcf54c38c"}
Sep 10 14:28:27.092998 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.092975    2561 generic.go:356] "Generic (PLEG): container finished" podID="92c4d9ff-163b-4310-841a-2657d78f963b" containerID="a7d0d89f9b9f2ba94d6efe00c4c8cf5f6a98bc93615f2583965db422c5e57237" exitCode=0
Sep 10 14:28:27.093083 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.093040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerDied","Data":"a7d0d89f9b9f2ba94d6efe00c4c8cf5f6a98bc93615f2583965db422c5e57237"}
Sep 10 14:28:27.093568 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.093520    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dxkvg" podStartSLOduration=3.175451232 podStartE2EDuration="21.093505118s" totalImagesPullingTime="17.918053886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:27.093389095 +0000 UTC m=+21.557755621" watchObservedRunningTime="2026-09-10 14:28:27.093505118 +0000 UTC m=+21.557871642"
Sep 10 14:28:27.093671 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.093623    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" podStartSLOduration=20.093613886 podStartE2EDuration="20.093613886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:11.06090805 +0000 UTC m=+5.525274575" watchObservedRunningTime="2026-09-10 14:28:27.093613886 +0000 UTC m=+21.557980409"
Sep 10 14:28:27.094906 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.094887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv" event={"ID":"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4","Type":"ContainerStarted","Data":"25ca482f891b7af5e3a2caa54401b3071a848ef105d7c69481a20da5a9815f80"}
Sep 10 14:28:27.109571 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.109522    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bn7hw" podStartSLOduration=3.187436533 podStartE2EDuration="21.109502895s" totalImagesPullingTime="17.922066362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:27.109441848 +0000 UTC m=+21.573808380" watchObservedRunningTime="2026-09-10 14:28:27.109502895 +0000 UTC m=+21.573869420"
Sep 10 14:28:27.127044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.126966    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8k6mr" podStartSLOduration=3.148080516 podStartE2EDuration="21.126951842s" totalImagesPullingTime="17.978871326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:27.12686723 +0000 UTC m=+21.591233751" watchObservedRunningTime="2026-09-10 14:28:27.126951842 +0000 UTC m=+21.591318364"
Sep 10 14:28:27.158294 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.158252    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7bbgl" podStartSLOduration=10.686334416 podStartE2EDuration="21.158235955s" totalImagesPullingTime="10.471901539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:27.14404434 +0000 UTC m=+21.608410862" watchObservedRunningTime="2026-09-10 14:28:27.158235955 +0000 UTC m=+21.622602539"
Sep 10 14:28:27.179852 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.179802    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lkcmg" podStartSLOduration=3.255949822 podStartE2EDuration="21.179784285s" totalImagesPullingTime="17.923834463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:27.158092569 +0000 UTC m=+21.622459091" watchObservedRunningTime="2026-09-10 14:28:27.179784285 +0000 UTC m=+21.644150807"
Sep 10 14:28:27.988394 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.988275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:27.988394 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.988275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:27.988394 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:27.988391    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:27.988617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:27.988422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:27.988617 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:27.988523    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:27.988679 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:27.988625    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:28.101357 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.101315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"231a1ee1aafcf36e2f45a482647a9ba6123ada17d63885310087bcc77a3f23a4"}
Sep 10 14:28:28.102020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.101410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"445d31e339f99799a17b765a06317bbcae5f7042752d7446cbeac30f49e27a43"}
Sep 10 14:28:28.289611 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.289573    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 14:28:28.716124 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.716088    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:28.716741 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.716695    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:28.946533 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.946429    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T14:28:28.289603729Z","UUID":"a201a9c6-e88e-44bb-a388-4894cb9e68f6","Handler":null,"Name":"","Endpoint":""}
Sep 10 14:28:28.948329 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.948308    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 14:28:28.948455 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:28.948340    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 14:28:29.106681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.106577    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv" event={"ID":"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4","Type":"ContainerStarted","Data":"bd19c94bc5abe7092812d909ea660bc5ed7c8f9537cb8aa1fbd3221fa3230bf7"}
Sep 10 14:28:29.108348 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.108320    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zk58x" event={"ID":"0fc3a8a2-3687-43b2-ac42-f8ad0fb27b4b","Type":"ContainerStarted","Data":"9bed0c839e848bdb329e29707b774d9b0a8352b20964f6642a1c4254b2f03211"}
Sep 10 14:28:29.108570 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.108520    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:29.108979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.108963    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7bbgl"
Sep 10 14:28:29.123100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.123007    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zk58x" podStartSLOduration=5.206684216 podStartE2EDuration="23.12298618s" totalImagesPullingTime="17.916301964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:29.122285165 +0000 UTC m=+23.586651687" watchObservedRunningTime="2026-09-10 14:28:29.12298618 +0000 UTC m=+23.587352703"
Sep 10 14:28:29.987759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.987721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:29.987951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.987766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:29.987951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:29.987726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:29.987951 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:29.987850    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:29.988083 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:29.987962    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:29.988083 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:29.988045    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:30.115009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:30.114967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"0c7689b7bf6d4025d98d2d481c5063365e52cd53bfeb2095ce64904ad742f8d4"}
Sep 10 14:28:30.117475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:30.117437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv" event={"ID":"eab8660b-bbeb-4fde-b0fb-82a60b35b6a4","Type":"ContainerStarted","Data":"1e45c0bfc7afb40dc712d1e0919e1fedf565ba097b1777f8809c14a746161222"}
Sep 10 14:28:30.149968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:30.149900    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m47pv" podStartSLOduration=3.885334207 podStartE2EDuration="24.149878874s" totalImagesPullingTime="20.264544667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:30.149490471 +0000 UTC m=+24.613856994" watchObservedRunningTime="2026-09-10 14:28:30.149878874 +0000 UTC m=+24.614245395"
Sep 10 14:28:31.987804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:31.987496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:31.988230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:31.987496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:31.988230 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:31.987914    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:31.988230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:31.987500    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:31.988230 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:31.987967    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:31.988230 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:31.988068    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:32.129681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.129583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" event={"ID":"d4ec1b44-ea72-4158-ad63-9a46cc7ab118","Type":"ContainerStarted","Data":"0a53496534fa7248f0da9aeb5e9710873ff146fafad8736e2311586cb28ad499"}
Sep 10 14:28:32.129891 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.129784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:32.129891 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.129843    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:32.130006 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.129932    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:32.131620 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.131595    2561 generic.go:356] "Generic (PLEG): container finished" podID="92c4d9ff-163b-4310-841a-2657d78f963b" containerID="7df6534a3659aa0502a5c7f58ade3e46b2d4e3694678659a052c24dde24452ce" exitCode=0
Sep 10 14:28:32.131778 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.131626    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerDied","Data":"7df6534a3659aa0502a5c7f58ade3e46b2d4e3694678659a052c24dde24452ce"}
Sep 10 14:28:32.146579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.146553    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:32.151919 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.151899    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:28:32.158795 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:32.158751    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t" podStartSLOduration=8.197289052 podStartE2EDuration="26.158735216s" totalImagesPullingTime="17.961446164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:32.157099967 +0000 UTC m=+26.621466488" watchObservedRunningTime="2026-09-10 14:28:32.158735216 +0000 UTC m=+26.623101737"
Sep 10 14:28:33.491652 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:33.491620    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8l7m8"]
Sep 10 14:28:33.492533 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:33.491749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:33.492533 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:33.491830    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:33.496336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:33.496307    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zcz7q"]
Sep 10 14:28:33.496463 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:33.496422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:33.496545 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:33.496521    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:33.496982 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:33.496962    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6sq6k"]
Sep 10 14:28:33.497077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:33.497062    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:33.497181 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:33.497164    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:34.138414 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:34.138378    2561 generic.go:356] "Generic (PLEG): container finished" podID="92c4d9ff-163b-4310-841a-2657d78f963b" containerID="798c4f268338e3e706e5a267cdd103810b1708503e444cb83bec0849f40f5f56" exitCode=0
Sep 10 14:28:34.138580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:34.138455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerDied","Data":"798c4f268338e3e706e5a267cdd103810b1708503e444cb83bec0849f40f5f56"}
Sep 10 14:28:34.987280 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:34.987244    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:34.987754 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:34.987352    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:34.987754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:34.987374    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:34.987754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:34.987245    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:34.987754 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:34.987722    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:34.987907 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:34.987777    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:36.145477 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:36.145292    2561 generic.go:356] "Generic (PLEG): container finished" podID="92c4d9ff-163b-4310-841a-2657d78f963b" containerID="c6a09afe40a0db264a670821d94d9f9a2d996d8c8288942df7dcb91ec723825e" exitCode=0
Sep 10 14:28:36.145477 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:36.145370    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerDied","Data":"c6a09afe40a0db264a670821d94d9f9a2d996d8c8288942df7dcb91ec723825e"}
Sep 10 14:28:36.915460 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:36.915434    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lkcmg_06815116-8ee8-46d9-bec0-0d14f714e090/dns-node-resolver/0.log"
Sep 10 14:28:36.987487 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:36.987433    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:36.987647 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:36.987436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:36.987647 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:36.987446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:36.987791 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:36.987658    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:36.987791 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:36.987750    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:36.988017 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:36.987983    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:37.888405 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:37.888330    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dxkvg_4abca780-21a2-427b-88de-fd7860f80cc6/node-ca/0.log"
Sep 10 14:28:38.987300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:38.987264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:38.987300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:38.987296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:38.987300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:38.987305    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:38.987785 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:38.987380    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sq6k" podUID="d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac"
Sep 10 14:28:38.987785 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:38.987491    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcz7q" podUID="fac44fb0-b5fc-45bb-99f1-b4557bd5c67f"
Sep 10 14:28:38.987785 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:38.987546    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8l7m8" podUID="a2302ed9-18a1-4e02-913d-ff52ce1e809a"
Sep 10 14:28:39.319448 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:39.319417    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeReady"
Sep 10 14:28:39.319628 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:39.319566    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 14:28:39.655474 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:39.655435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:39.655504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:39.655530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655613    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655639    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655642    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655653    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x4j for pod openshift-network-diagnostics/network-check-target-zcz7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655642    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:39.655722 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655726    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j podName:fac44fb0-b5fc-45bb-99f1-b4557bd5c67f nodeName:}" failed. No retries permitted until 2026-09-10 14:29:11.655691114 +0000 UTC m=+66.120057615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x4j" (UniqueName: "kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j") pod "network-check-target-zcz7q" (UID: "fac44fb0-b5fc-45bb-99f1-b4557bd5c67f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:28:39.656145 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655746    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret podName:a2302ed9-18a1-4e02-913d-ff52ce1e809a nodeName:}" failed. No retries permitted until 2026-09-10 14:29:11.655737773 +0000 UTC m=+66.120104272 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret") pod "global-pull-secret-syncer-8l7m8" (UID: "a2302ed9-18a1-4e02-913d-ff52ce1e809a") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:28:39.656145 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:28:39.655770    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs podName:d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac nodeName:}" failed. No retries permitted until 2026-09-10 14:29:11.655757948 +0000 UTC m=+66.120124468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs") pod "network-metrics-daemon-6sq6k" (UID: "d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:28:40.988112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.988072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:28:40.988112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.988114    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:28:40.988613 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.988076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:28:40.992016 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.991528    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pptck\""
Sep 10 14:28:40.992016 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.991544    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:28:40.992783 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.992668    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:28:40.992783 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.992726    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:28:40.992964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.992805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:28:40.992964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:40.992890    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf25v\""
Sep 10 14:28:41.163081 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:41.163054    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerStarted","Data":"0314e82c6cbf39966e3acf3d2f890cb15b18bf24237e8f32d9bc4d930e2e4fa9"}
Sep 10 14:28:42.167827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:42.167762    2561 generic.go:356] "Generic (PLEG): container finished" podID="92c4d9ff-163b-4310-841a-2657d78f963b" containerID="0314e82c6cbf39966e3acf3d2f890cb15b18bf24237e8f32d9bc4d930e2e4fa9" exitCode=0
Sep 10 14:28:42.168165 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:42.167847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerDied","Data":"0314e82c6cbf39966e3acf3d2f890cb15b18bf24237e8f32d9bc4d930e2e4fa9"}
Sep 10 14:28:43.173489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:43.173309    2561 generic.go:356] "Generic (PLEG): container finished" podID="92c4d9ff-163b-4310-841a-2657d78f963b" containerID="6aec432232535e214b46bc4a0011ac8f86e9ad6febff52ab7dcd980e87ab4eb0" exitCode=0
Sep 10 14:28:43.173489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:43.173386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerDied","Data":"6aec432232535e214b46bc4a0011ac8f86e9ad6febff52ab7dcd980e87ab4eb0"}
Sep 10 14:28:44.179345 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:44.179308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" event={"ID":"92c4d9ff-163b-4310-841a-2657d78f963b","Type":"ContainerStarted","Data":"3a4e64541a8fdfb2988abb6457da66a8726c628206c72aa972fd41e91ff33dd6"}
Sep 10 14:28:44.201783 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:28:44.201731    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r5t6h" podStartSLOduration=8.471786291 podStartE2EDuration="38.201695217s" totalImagesPullingTime="29.729908926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:44.200063492 +0000 UTC m=+38.664430015" watchObservedRunningTime="2026-09-10 14:28:44.201695217 +0000 UTC m=+38.666061739"
Sep 10 14:29:02.040799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.040736    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-sjzgm"]
Sep 10 14:29:02.042657 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.042632    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-nwhvv"]
Sep 10 14:29:02.042821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.042789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-sjzgm"
Sep 10 14:29:02.044130 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.044112    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56678d7b8d-wr98f"]
Sep 10 14:29:02.044272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.044254    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.045465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.045450    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ftbx7"]
Sep 10 14:29:02.045589 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.045572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.047241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.047221    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z99pd"]
Sep 10 14:29:02.047332 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.047323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.049100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.049084    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.050055 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.050033    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-29ts5\""
Sep 10 14:29:02.054382 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.054366    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 14:29:02.054583 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.054565    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hw2bw\""
Sep 10 14:29:02.054867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.054852    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 14:29:02.055160 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.055144    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 14:29:02.055239 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.055157    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 14:29:02.056208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.056003    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 14:29:02.057546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.057532    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2kwcf\""
Sep 10 14:29:02.057612 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.057567    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 14:29:02.061469 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.061445    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 14:29:02.061569 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.061454    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsf8q\""
Sep 10 14:29:02.061827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.061797    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 14:29:02.062014 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.061999    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 14:29:02.062093 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.062032    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 14:29:02.066196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.066176    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 14:29:02.066437 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.066419    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 14:29:02.066533 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.066443    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fc42h\""
Sep 10 14:29:02.066533 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.066497    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 14:29:02.073011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.072986    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-nwhvv"]
Sep 10 14:29:02.079848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.079829    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 14:29:02.084759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.084735    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z99pd"]
Sep 10 14:29:02.089425 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.089405    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56678d7b8d-wr98f"]
Sep 10 14:29:02.090587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.090566    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-sjzgm"]
Sep 10 14:29:02.095839 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.095814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftbx7"]
Sep 10 14:29:02.151691 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.149936    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zkx2k"]
Sep 10 14:29:02.169211 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.169174    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkx2k"]
Sep 10 14:29:02.169403 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.169325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.172466 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.172444    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z67dn\""
Sep 10 14:29:02.172761 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.172742    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 14:29:02.172906 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.172883    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 14:29:02.173033 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.173012    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 14:29:02.211980 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.211948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkh26\" (UniqueName: \"kubernetes.io/projected/d6503583-fa96-4abf-8358-e111d26dd240-kube-api-access-mkh26\") pod \"downloads-85d98c998f-sjzgm\" (UID: \"d6503583-fa96-4abf-8358-e111d26dd240\") " pod="openshift-console/downloads-85d98c998f-sjzgm"
Sep 10 14:29:02.211980 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.211981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4828db3-d66a-4eb1-9350-645e57de1864-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.212234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4828db3-d66a-4eb1-9350-645e57de1864-data-volume\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.212234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6207832-42db-4634-b766-5ac799985fee-config-volume\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.212234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6207832-42db-4634-b766-5ac799985fee-metrics-tls\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.212234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12a3e115-7e26-4bdd-b077-c71259f6dd57-image-registry-private-configuration\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9bec94c-eca2-4d41-bff0-7a1bf2abb439-nginx-conf\") pod \"networking-console-plugin-79977f9844-nwhvv\" (UID: \"d9bec94c-eca2-4d41-bff0-7a1bf2abb439\") " pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.212234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-registry-tls\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212185    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvhr\" (UniqueName: \"kubernetes.io/projected/a4828db3-d66a-4eb1-9350-645e57de1864-kube-api-access-wrvhr\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12a3e115-7e26-4bdd-b077-c71259f6dd57-registry-certificates\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpp7l\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-kube-api-access-gpp7l\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12a3e115-7e26-4bdd-b077-c71259f6dd57-installation-pull-secrets\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/d6207832-42db-4634-b766-5ac799985fee-kube-api-access-m9bnk\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9bec94c-eca2-4d41-bff0-7a1bf2abb439-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-nwhvv\" (UID: \"d9bec94c-eca2-4d41-bff0-7a1bf2abb439\") " pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-bound-sa-token\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6207832-42db-4634-b766-5ac799985fee-tmp-dir\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4828db3-d66a-4eb1-9350-645e57de1864-crio-socket\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12a3e115-7e26-4bdd-b077-c71259f6dd57-ca-trust-extracted\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12a3e115-7e26-4bdd-b077-c71259f6dd57-trusted-ca\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.212854 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.212524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4828db3-d66a-4eb1-9350-645e57de1864-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.313293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9bec94c-eca2-4d41-bff0-7a1bf2abb439-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-nwhvv\" (UID: \"d9bec94c-eca2-4d41-bff0-7a1bf2abb439\") " pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.313293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-bound-sa-token\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.313293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58w7g\" (UniqueName: \"kubernetes.io/projected/1e60d686-fbc7-496e-b416-f440fbbd8e17-kube-api-access-58w7g\") pod \"ingress-canary-zkx2k\" (UID: \"1e60d686-fbc7-496e-b416-f440fbbd8e17\") " pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6207832-42db-4634-b766-5ac799985fee-tmp-dir\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4828db3-d66a-4eb1-9350-645e57de1864-crio-socket\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12a3e115-7e26-4bdd-b077-c71259f6dd57-ca-trust-extracted\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12a3e115-7e26-4bdd-b077-c71259f6dd57-trusted-ca\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4828db3-d66a-4eb1-9350-645e57de1864-crio-socket\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4828db3-d66a-4eb1-9350-645e57de1864-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkh26\" (UniqueName: \"kubernetes.io/projected/d6503583-fa96-4abf-8358-e111d26dd240-kube-api-access-mkh26\") pod \"downloads-85d98c998f-sjzgm\" (UID: \"d6503583-fa96-4abf-8358-e111d26dd240\") " pod="openshift-console/downloads-85d98c998f-sjzgm"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4828db3-d66a-4eb1-9350-645e57de1864-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.313574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4828db3-d66a-4eb1-9350-645e57de1864-data-volume\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e60d686-fbc7-496e-b416-f440fbbd8e17-cert\") pod \"ingress-canary-zkx2k\" (UID: \"1e60d686-fbc7-496e-b416-f440fbbd8e17\") " pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313628    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6207832-42db-4634-b766-5ac799985fee-config-volume\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6207832-42db-4634-b766-5ac799985fee-metrics-tls\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6207832-42db-4634-b766-5ac799985fee-tmp-dir\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12a3e115-7e26-4bdd-b077-c71259f6dd57-image-registry-private-configuration\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9bec94c-eca2-4d41-bff0-7a1bf2abb439-nginx-conf\") pod \"networking-console-plugin-79977f9844-nwhvv\" (UID: \"d9bec94c-eca2-4d41-bff0-7a1bf2abb439\") " pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-registry-tls\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313858    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvhr\" (UniqueName: \"kubernetes.io/projected/a4828db3-d66a-4eb1-9350-645e57de1864-kube-api-access-wrvhr\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313887    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12a3e115-7e26-4bdd-b077-c71259f6dd57-ca-trust-extracted\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.313973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.313894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12a3e115-7e26-4bdd-b077-c71259f6dd57-registry-certificates\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.314482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6207832-42db-4634-b766-5ac799985fee-config-volume\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.314541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9bec94c-eca2-4d41-bff0-7a1bf2abb439-nginx-conf\") pod \"networking-console-plugin-79977f9844-nwhvv\" (UID: \"d9bec94c-eca2-4d41-bff0-7a1bf2abb439\") " pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.315013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12a3e115-7e26-4bdd-b077-c71259f6dd57-registry-certificates\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.315013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpp7l\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-kube-api-access-gpp7l\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.315013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12a3e115-7e26-4bdd-b077-c71259f6dd57-installation-pull-secrets\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.315013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/d6207832-42db-4634-b766-5ac799985fee-kube-api-access-m9bnk\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.315013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12a3e115-7e26-4bdd-b077-c71259f6dd57-trusted-ca\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.315013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.314909    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4828db3-d66a-4eb1-9350-645e57de1864-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.315356 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.315197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4828db3-d66a-4eb1-9350-645e57de1864-data-volume\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.317872 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.317841    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4828db3-d66a-4eb1-9350-645e57de1864-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.318008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.317987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12a3e115-7e26-4bdd-b077-c71259f6dd57-image-registry-private-configuration\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.318059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.318007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6207832-42db-4634-b766-5ac799985fee-metrics-tls\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.318059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.318021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9bec94c-eca2-4d41-bff0-7a1bf2abb439-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-nwhvv\" (UID: \"d9bec94c-eca2-4d41-bff0-7a1bf2abb439\") " pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.318129 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.318060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-registry-tls\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.318279 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.318260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12a3e115-7e26-4bdd-b077-c71259f6dd57-installation-pull-secrets\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.326794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.326697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkh26\" (UniqueName: \"kubernetes.io/projected/d6503583-fa96-4abf-8358-e111d26dd240-kube-api-access-mkh26\") pod \"downloads-85d98c998f-sjzgm\" (UID: \"d6503583-fa96-4abf-8358-e111d26dd240\") " pod="openshift-console/downloads-85d98c998f-sjzgm"
Sep 10 14:29:02.326985 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.326959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpp7l\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-kube-api-access-gpp7l\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.327087 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.327071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/d6207832-42db-4634-b766-5ac799985fee-kube-api-access-m9bnk\") pod \"dns-default-ftbx7\" (UID: \"d6207832-42db-4634-b766-5ac799985fee\") " pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.327196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.327177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12a3e115-7e26-4bdd-b077-c71259f6dd57-bound-sa-token\") pod \"image-registry-56678d7b8d-wr98f\" (UID: \"12a3e115-7e26-4bdd-b077-c71259f6dd57\") " pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.327893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.327873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvhr\" (UniqueName: \"kubernetes.io/projected/a4828db3-d66a-4eb1-9350-645e57de1864-kube-api-access-wrvhr\") pod \"insights-runtime-extractor-z99pd\" (UID: \"a4828db3-d66a-4eb1-9350-645e57de1864\") " pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.352818 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.352781    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-sjzgm"
Sep 10 14:29:02.358526 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.358502    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv"
Sep 10 14:29:02.364444 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.364416    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:02.370317 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.370285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:02.376339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.376306    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z99pd"
Sep 10 14:29:02.416861 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.416178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58w7g\" (UniqueName: \"kubernetes.io/projected/1e60d686-fbc7-496e-b416-f440fbbd8e17-kube-api-access-58w7g\") pod \"ingress-canary-zkx2k\" (UID: \"1e60d686-fbc7-496e-b416-f440fbbd8e17\") " pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.416861 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.416250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e60d686-fbc7-496e-b416-f440fbbd8e17-cert\") pod \"ingress-canary-zkx2k\" (UID: \"1e60d686-fbc7-496e-b416-f440fbbd8e17\") " pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.420076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.420010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e60d686-fbc7-496e-b416-f440fbbd8e17-cert\") pod \"ingress-canary-zkx2k\" (UID: \"1e60d686-fbc7-496e-b416-f440fbbd8e17\") " pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.429991 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.429933    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58w7g\" (UniqueName: \"kubernetes.io/projected/1e60d686-fbc7-496e-b416-f440fbbd8e17-kube-api-access-58w7g\") pod \"ingress-canary-zkx2k\" (UID: \"1e60d686-fbc7-496e-b416-f440fbbd8e17\") " pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.479849 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.479563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zkx2k"
Sep 10 14:29:02.644479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.644367    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-sjzgm"]
Sep 10 14:29:02.648633 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.648601    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-nwhvv"]
Sep 10 14:29:02.649327 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:02.649301    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6503583_fa96_4abf_8358_e111d26dd240.slice/crio-bfb870b7fc52a1f06d773fd168abb53bf405d0e4d3a3f2beefbfdcf3be497467 WatchSource:0}: Error finding container bfb870b7fc52a1f06d773fd168abb53bf405d0e4d3a3f2beefbfdcf3be497467: Status 404 returned error can't find the container with id bfb870b7fc52a1f06d773fd168abb53bf405d0e4d3a3f2beefbfdcf3be497467
Sep 10 14:29:02.651339 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:02.651294    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bec94c_eca2_4d41_bff0_7a1bf2abb439.slice/crio-2ca7d73563fdc87e351350e092687e8dad6188c6ba5805a806ab3136d05939a3 WatchSource:0}: Error finding container 2ca7d73563fdc87e351350e092687e8dad6188c6ba5805a806ab3136d05939a3: Status 404 returned error can't find the container with id 2ca7d73563fdc87e351350e092687e8dad6188c6ba5805a806ab3136d05939a3
Sep 10 14:29:02.664121 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.664093    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftbx7"]
Sep 10 14:29:02.666851 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:02.666821    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6207832_42db_4634_b766_5ac799985fee.slice/crio-41e5b759e4696428e45b64400e916ac5da975ad542ccf43846640f4133804ce3 WatchSource:0}: Error finding container 41e5b759e4696428e45b64400e916ac5da975ad542ccf43846640f4133804ce3: Status 404 returned error can't find the container with id 41e5b759e4696428e45b64400e916ac5da975ad542ccf43846640f4133804ce3
Sep 10 14:29:02.671663 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.671631    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56678d7b8d-wr98f"]
Sep 10 14:29:02.673970 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:02.673943    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a3e115_7e26_4bdd_b077_c71259f6dd57.slice/crio-948fd9b7a20b0e3f5d23e0191dd11b6f56a3d4433e8b982e0c2881e3238bf123 WatchSource:0}: Error finding container 948fd9b7a20b0e3f5d23e0191dd11b6f56a3d4433e8b982e0c2881e3238bf123: Status 404 returned error can't find the container with id 948fd9b7a20b0e3f5d23e0191dd11b6f56a3d4433e8b982e0c2881e3238bf123
Sep 10 14:29:02.696360 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.696332    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z99pd"]
Sep 10 14:29:02.701740 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:02.701689    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4828db3_d66a_4eb1_9350_645e57de1864.slice/crio-a73a03fafdd462c102630deb124e1d196dbcb7b9ec0b6bb18d4ce21f8b78c31f WatchSource:0}: Error finding container a73a03fafdd462c102630deb124e1d196dbcb7b9ec0b6bb18d4ce21f8b78c31f: Status 404 returned error can't find the container with id a73a03fafdd462c102630deb124e1d196dbcb7b9ec0b6bb18d4ce21f8b78c31f
Sep 10 14:29:02.749769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:02.749728    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zkx2k"]
Sep 10 14:29:02.753329 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:02.753299    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e60d686_fbc7_496e_b416_f440fbbd8e17.slice/crio-985c4eb239c59255d15f5e5cc3de1ebf9c40534af450374c9bb465b5ea968925 WatchSource:0}: Error finding container 985c4eb239c59255d15f5e5cc3de1ebf9c40534af450374c9bb465b5ea968925: Status 404 returned error can't find the container with id 985c4eb239c59255d15f5e5cc3de1ebf9c40534af450374c9bb465b5ea968925
Sep 10 14:29:03.227369 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.227287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv" event={"ID":"d9bec94c-eca2-4d41-bff0-7a1bf2abb439","Type":"ContainerStarted","Data":"2ca7d73563fdc87e351350e092687e8dad6188c6ba5805a806ab3136d05939a3"}
Sep 10 14:29:03.230144 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.230105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkx2k" event={"ID":"1e60d686-fbc7-496e-b416-f440fbbd8e17","Type":"ContainerStarted","Data":"985c4eb239c59255d15f5e5cc3de1ebf9c40534af450374c9bb465b5ea968925"}
Sep 10 14:29:03.232455 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.232347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z99pd" event={"ID":"a4828db3-d66a-4eb1-9350-645e57de1864","Type":"ContainerStarted","Data":"e1cfb2f77c284ca2fc294454236eabd67a271144573cbc27dac583861b6120c1"}
Sep 10 14:29:03.232455 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.232414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z99pd" event={"ID":"a4828db3-d66a-4eb1-9350-645e57de1864","Type":"ContainerStarted","Data":"a73a03fafdd462c102630deb124e1d196dbcb7b9ec0b6bb18d4ce21f8b78c31f"}
Sep 10 14:29:03.233886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.233857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-sjzgm" event={"ID":"d6503583-fa96-4abf-8358-e111d26dd240","Type":"ContainerStarted","Data":"bfb870b7fc52a1f06d773fd168abb53bf405d0e4d3a3f2beefbfdcf3be497467"}
Sep 10 14:29:03.235485 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.235413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftbx7" event={"ID":"d6207832-42db-4634-b766-5ac799985fee","Type":"ContainerStarted","Data":"41e5b759e4696428e45b64400e916ac5da975ad542ccf43846640f4133804ce3"}
Sep 10 14:29:03.238323 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.237496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56678d7b8d-wr98f" event={"ID":"12a3e115-7e26-4bdd-b077-c71259f6dd57","Type":"ContainerStarted","Data":"d86a4717524b67f04e00318f42a08a1dd0b066f6a37333c2460a26e3efff6f3a"}
Sep 10 14:29:03.238323 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.237540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56678d7b8d-wr98f" event={"ID":"12a3e115-7e26-4bdd-b077-c71259f6dd57","Type":"ContainerStarted","Data":"948fd9b7a20b0e3f5d23e0191dd11b6f56a3d4433e8b982e0c2881e3238bf123"}
Sep 10 14:29:03.238323 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.238277    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:03.259830 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:03.259737    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56678d7b8d-wr98f" podStartSLOduration=1.259713477 podStartE2EDuration="1.259713477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:03.259055369 +0000 UTC m=+57.723421903" watchObservedRunningTime="2026-09-10 14:29:03.259713477 +0000 UTC m=+57.724079991"
Sep 10 14:29:04.164497 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:04.163995    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpb5t"
Sep 10 14:29:04.244984 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:04.244884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z99pd" event={"ID":"a4828db3-d66a-4eb1-9350-645e57de1864","Type":"ContainerStarted","Data":"32e8b4ce235cf52206ae87cbd5ecf3b027165ae0b359301221e9f91442fce1e1"}
Sep 10 14:29:07.257357 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.257313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zkx2k" event={"ID":"1e60d686-fbc7-496e-b416-f440fbbd8e17","Type":"ContainerStarted","Data":"b498985d11865464b1bb235a5d2dac502861ad9ee29c12ec9213a56eeabcc951"}
Sep 10 14:29:07.259961 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.259932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z99pd" event={"ID":"a4828db3-d66a-4eb1-9350-645e57de1864","Type":"ContainerStarted","Data":"148709b1a76bc93f1a7ae761dfb2d8a94f8ca46a14541d01dbd7787ee02efd1f"}
Sep 10 14:29:07.262012 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.261985    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftbx7" event={"ID":"d6207832-42db-4634-b766-5ac799985fee","Type":"ContainerStarted","Data":"1e164e5cad73deacf0b49e657b5fdb0d61ea4f124525ff65fac9a79bdfe7c7aa"}
Sep 10 14:29:07.262152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.262034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftbx7" event={"ID":"d6207832-42db-4634-b766-5ac799985fee","Type":"ContainerStarted","Data":"188c0390a293a841226cc891c0373ce4edf43569fada55b7dc1a8d620d12e259"}
Sep 10 14:29:07.262152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.262064    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:07.263761 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.263735    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv" event={"ID":"d9bec94c-eca2-4d41-bff0-7a1bf2abb439","Type":"ContainerStarted","Data":"6a214d4e97db56f2b2af3f3f988822240e1e0e14f7d797737d685b2283ca3674"}
Sep 10 14:29:07.272910 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.272861    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zkx2k" podStartSLOduration=1.52055329 podStartE2EDuration="5.272844761s" totalImagesPullingTime="3.752291471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:07.272814096 +0000 UTC m=+61.737180619" watchObservedRunningTime="2026-09-10 14:29:07.272844761 +0000 UTC m=+61.737211278"
Sep 10 14:29:07.292001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.291941    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ftbx7" podStartSLOduration=1.45263085 podStartE2EDuration="5.291919903s" totalImagesPullingTime="3.839289053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:07.291105052 +0000 UTC m=+61.755471574" watchObservedRunningTime="2026-09-10 14:29:07.291919903 +0000 UTC m=+61.756286429"
Sep 10 14:29:07.306492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.306433    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-nwhvv" podStartSLOduration=1.451390136 podStartE2EDuration="5.306413006s" totalImagesPullingTime="3.85502287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:07.305946031 +0000 UTC m=+61.770312554" watchObservedRunningTime="2026-09-10 14:29:07.306413006 +0000 UTC m=+61.770779524"
Sep 10 14:29:07.327426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:07.327363    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z99pd" podStartSLOduration=1.6826662159999999 podStartE2EDuration="5.32734786s" totalImagesPullingTime="3.644681644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:29:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:07.326346293 +0000 UTC m=+61.790712816" watchObservedRunningTime="2026-09-10 14:29:07.32734786 +0000 UTC m=+61.791714382"
Sep 10 14:29:09.698965 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:09.698932    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"]
Sep 10 14:29:09.703748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:09.703700    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:09.706318 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:09.706286    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 14:29:09.706318 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:09.706315    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h5l8n\""
Sep 10 14:29:09.710086 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:09.710054    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"]
Sep 10 14:29:09.781018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:09.780981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/48ea2495-a5f9-4b92-a206-5bf4f1861794-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gbp49\" (UID: \"48ea2495-a5f9-4b92-a206-5bf4f1861794\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:09.881716 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:09.881665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/48ea2495-a5f9-4b92-a206-5bf4f1861794-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gbp49\" (UID: \"48ea2495-a5f9-4b92-a206-5bf4f1861794\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:09.881889 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:09.881842    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 14:29:09.881945 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:09.881919    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48ea2495-a5f9-4b92-a206-5bf4f1861794-tls-certificates podName:48ea2495-a5f9-4b92-a206-5bf4f1861794 nodeName:}" failed. No retries permitted until 2026-09-10 14:29:10.381897069 +0000 UTC m=+64.846263570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/48ea2495-a5f9-4b92-a206-5bf4f1861794-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-gbp49" (UID: "48ea2495-a5f9-4b92-a206-5bf4f1861794") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 14:29:10.386078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.386034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/48ea2495-a5f9-4b92-a206-5bf4f1861794-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gbp49\" (UID: \"48ea2495-a5f9-4b92-a206-5bf4f1861794\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:10.388684 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.388647    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/48ea2495-a5f9-4b92-a206-5bf4f1861794-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gbp49\" (UID: \"48ea2495-a5f9-4b92-a206-5bf4f1861794\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:10.616993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.616943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:10.696221 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.695639    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-598bff97b5-ffskg"]
Sep 10 14:29:10.700145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.700120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.703056 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.702825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 14:29:10.703982 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.703961    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfq9n\""
Sep 10 14:29:10.704075 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.704012    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 14:29:10.704120 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.704012    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 14:29:10.704120 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.704011    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 14:29:10.704178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.703959    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 14:29:10.709532 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.709510    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-598bff97b5-ffskg"]
Sep 10 14:29:10.790175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.790143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-serving-cert\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.790351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.790208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jh9\" (UniqueName: \"kubernetes.io/projected/02c83545-a2f6-4aef-9f9a-14745b3892ac-kube-api-access-q7jh9\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.790351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.790254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-service-ca\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.790351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.790273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-config\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.790351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.790306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-oauth-config\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.790519 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.790368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-oauth-serving-cert\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.891054 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.891018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-serving-cert\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.891054 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.891071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jh9\" (UniqueName: \"kubernetes.io/projected/02c83545-a2f6-4aef-9f9a-14745b3892ac-kube-api-access-q7jh9\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.891300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.891095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-service-ca\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.891300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.891117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-config\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.891300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.891179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-oauth-config\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.891300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.891205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-oauth-serving-cert\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.892016 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.891988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-oauth-serving-cert\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.892016 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.892005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-service-ca\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.892178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.892005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-config\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.894116 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.894089    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-oauth-config\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.894227 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.894126    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-serving-cert\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.898632 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.898603    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"]
Sep 10 14:29:10.902094 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:10.902074    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jh9\" (UniqueName: \"kubernetes.io/projected/02c83545-a2f6-4aef-9f9a-14745b3892ac-kube-api-access-q7jh9\") pod \"console-598bff97b5-ffskg\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") " pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:10.903370 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:10.903344    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ea2495_a5f9_4b92_a206_5bf4f1861794.slice/crio-fd2fdfc386d5eaedba02af0f1c3af210525ea90b41ad20b4c01f2bd6d3202067 WatchSource:0}: Error finding container fd2fdfc386d5eaedba02af0f1c3af210525ea90b41ad20b4c01f2bd6d3202067: Status 404 returned error can't find the container with id fd2fdfc386d5eaedba02af0f1c3af210525ea90b41ad20b4c01f2bd6d3202067
Sep 10 14:29:11.012076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.011989    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:11.283939 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.283859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49" event={"ID":"48ea2495-a5f9-4b92-a206-5bf4f1861794","Type":"ContainerStarted","Data":"fd2fdfc386d5eaedba02af0f1c3af210525ea90b41ad20b4c01f2bd6d3202067"}
Sep 10 14:29:11.293873 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.293829    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-598bff97b5-ffskg"]
Sep 10 14:29:11.298275 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:11.298234    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c83545_a2f6_4aef_9f9a_14745b3892ac.slice/crio-fe748ac175eb91e52b5efaadd619042e4f65d5219dad46f81d6beb130459dde4 WatchSource:0}: Error finding container fe748ac175eb91e52b5efaadd619042e4f65d5219dad46f81d6beb130459dde4: Status 404 returned error can't find the container with id fe748ac175eb91e52b5efaadd619042e4f65d5219dad46f81d6beb130459dde4
Sep 10 14:29:11.697009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.696964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:29:11.697194 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.697028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:29:11.697194 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.697063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:29:11.699906 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.699830    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:29:11.701251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.700959    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:29:11.701251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.701206    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:29:11.709980 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.709798    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:29:11.710307 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.710280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a2302ed9-18a1-4e02-913d-ff52ce1e809a-original-pull-secret\") pod \"global-pull-secret-syncer-8l7m8\" (UID: \"a2302ed9-18a1-4e02-913d-ff52ce1e809a\") " pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:29:11.710426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.710376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac-metrics-certs\") pod \"network-metrics-daemon-6sq6k\" (UID: \"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac\") " pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:29:11.720620 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.720597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69x4j\" (UniqueName: \"kubernetes.io/projected/fac44fb0-b5fc-45bb-99f1-b4557bd5c67f-kube-api-access-69x4j\") pod \"network-check-target-zcz7q\" (UID: \"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f\") " pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:29:11.904386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.904353    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf25v\""
Sep 10 14:29:11.908324 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.908291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8l7m8"
Sep 10 14:29:11.912366 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.912334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sq6k"
Sep 10 14:29:11.918414 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.918392    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pptck\""
Sep 10 14:29:11.925789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:11.925762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:29:12.289909 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:12.289819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598bff97b5-ffskg" event={"ID":"02c83545-a2f6-4aef-9f9a-14745b3892ac","Type":"ContainerStarted","Data":"fe748ac175eb91e52b5efaadd619042e4f65d5219dad46f81d6beb130459dde4"}
Sep 10 14:29:12.614361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:12.614225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zcz7q"]
Sep 10 14:29:12.620398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:12.620368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8l7m8"]
Sep 10 14:29:12.623026 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:12.622986    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6sq6k"]
Sep 10 14:29:17.270415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.270381    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ftbx7"
Sep 10 14:29:17.874856 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.874819    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858d4bd764-7mzsm"]
Sep 10 14:29:17.877110 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.877084    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:17.890977 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.890944    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 14:29:17.891261 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.891232    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858d4bd764-7mzsm"]
Sep 10 14:29:17.943860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.943818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5xdp\" (UniqueName: \"kubernetes.io/projected/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-kube-api-access-q5xdp\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:17.944038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.943874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-oauth-serving-cert\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:17.944038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.943948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-serving-cert\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:17.944038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.943985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-service-ca\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:17.944038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.944018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-oauth-config\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:17.944188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.944041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-trusted-ca-bundle\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:17.944188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:17.944110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-config\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.045348 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.045303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-oauth-serving-cert\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.045348 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.045347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-serving-cert\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.045601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.045367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-service-ca\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.045866 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.045826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-oauth-config\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.045984 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.045884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-trusted-ca-bundle\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.046253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.046096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-config\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.046253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.046142    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-service-ca\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.046253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.046180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5xdp\" (UniqueName: \"kubernetes.io/projected/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-kube-api-access-q5xdp\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.046253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.046185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-oauth-serving-cert\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.046751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.046727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-trusted-ca-bundle\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.046856 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.046740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-config\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.048276 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.048252    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-serving-cert\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.048888 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.048868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-oauth-config\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.056292 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.056269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5xdp\" (UniqueName: \"kubernetes.io/projected/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-kube-api-access-q5xdp\") pod \"console-858d4bd764-7mzsm\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") " pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:18.192373 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:18.192326    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:19.567346 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:19.567308    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2302ed9_18a1_4e02_913d_ff52ce1e809a.slice/crio-a53393e516cca7ff7b3978f8c15bc70b76a932670aa9ba4e100d7990045f5ea4 WatchSource:0}: Error finding container a53393e516cca7ff7b3978f8c15bc70b76a932670aa9ba4e100d7990045f5ea4: Status 404 returned error can't find the container with id a53393e516cca7ff7b3978f8c15bc70b76a932670aa9ba4e100d7990045f5ea4
Sep 10 14:29:19.568141 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:19.568078    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c0ca54_7b5c_498c_ad17_6ddd2a7107ac.slice/crio-16f7bd2f8816c747e968a918e3728c8a1f6451b69d4a8144634b13a8fa94411e WatchSource:0}: Error finding container 16f7bd2f8816c747e968a918e3728c8a1f6451b69d4a8144634b13a8fa94411e: Status 404 returned error can't find the container with id 16f7bd2f8816c747e968a918e3728c8a1f6451b69d4a8144634b13a8fa94411e
Sep 10 14:29:20.322050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:20.322006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8l7m8" event={"ID":"a2302ed9-18a1-4e02-913d-ff52ce1e809a","Type":"ContainerStarted","Data":"a53393e516cca7ff7b3978f8c15bc70b76a932670aa9ba4e100d7990045f5ea4"}
Sep 10 14:29:20.323492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:20.323465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6sq6k" event={"ID":"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac","Type":"ContainerStarted","Data":"16f7bd2f8816c747e968a918e3728c8a1f6451b69d4a8144634b13a8fa94411e"}
Sep 10 14:29:20.584407 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:20.584330    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac44fb0_b5fc_45bb_99f1_b4557bd5c67f.slice/crio-f7daea65991e9ebd4e1d831295b6da0cbfcf9f19012314ffd46caa217c3a356a WatchSource:0}: Error finding container f7daea65991e9ebd4e1d831295b6da0cbfcf9f19012314ffd46caa217c3a356a: Status 404 returned error can't find the container with id f7daea65991e9ebd4e1d831295b6da0cbfcf9f19012314ffd46caa217c3a356a
Sep 10 14:29:20.882123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:20.882029    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858d4bd764-7mzsm"]
Sep 10 14:29:20.886435 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:20.886395    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71874a96_f6e5_40d5_a2aa_d43b6dcf32ec.slice/crio-4b9dbb6c631dea3aafe9143b77b8f2c0864e5c75ebdfc32c3296d11b89ca5be8 WatchSource:0}: Error finding container 4b9dbb6c631dea3aafe9143b77b8f2c0864e5c75ebdfc32c3296d11b89ca5be8: Status 404 returned error can't find the container with id 4b9dbb6c631dea3aafe9143b77b8f2c0864e5c75ebdfc32c3296d11b89ca5be8
Sep 10 14:29:21.347658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.347614    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598bff97b5-ffskg" event={"ID":"02c83545-a2f6-4aef-9f9a-14745b3892ac","Type":"ContainerStarted","Data":"c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd"}
Sep 10 14:29:21.350598 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.350568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d4bd764-7mzsm" event={"ID":"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec","Type":"ContainerStarted","Data":"34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066"}
Sep 10 14:29:21.350847 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.350831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d4bd764-7mzsm" event={"ID":"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec","Type":"ContainerStarted","Data":"4b9dbb6c631dea3aafe9143b77b8f2c0864e5c75ebdfc32c3296d11b89ca5be8"}
Sep 10 14:29:21.354204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.353868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49" event={"ID":"48ea2495-a5f9-4b92-a206-5bf4f1861794","Type":"ContainerStarted","Data":"ff9660ea097fa1ad28dab1605fa2e221b18e3ff072e352190c4b381bfbc7ff94"}
Sep 10 14:29:21.354204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.354014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:21.358343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.358292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-sjzgm" event={"ID":"d6503583-fa96-4abf-8358-e111d26dd240","Type":"ContainerStarted","Data":"21f5b5e69771e2a2a18942b65938ceb670ec5cf75e45c3e400c21bf08b9c2488"}
Sep 10 14:29:21.358780 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.358765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-sjzgm"
Sep 10 14:29:21.359773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.359748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zcz7q" event={"ID":"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f","Type":"ContainerStarted","Data":"f7daea65991e9ebd4e1d831295b6da0cbfcf9f19012314ffd46caa217c3a356a"}
Sep 10 14:29:21.361935 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.361917    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49"
Sep 10 14:29:21.367609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.367566    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-598bff97b5-ffskg" podStartSLOduration=2.050370921 podStartE2EDuration="11.367551331s" totalImagesPullingTime="9.31718041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:21.365402358 +0000 UTC m=+75.829768903" watchObservedRunningTime="2026-09-10 14:29:21.367551331 +0000 UTC m=+75.831917847"
Sep 10 14:29:21.380775 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.380688    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-sjzgm"
Sep 10 14:29:21.382776 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.382654    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858d4bd764-7mzsm" podStartSLOduration=4.382634192 podStartE2EDuration="4.382634192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:21.381768467 +0000 UTC m=+75.846134988" watchObservedRunningTime="2026-09-10 14:29:21.382634192 +0000 UTC m=+75.847000715"
Sep 10 14:29:21.403053 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.401880    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-sjzgm" podStartSLOduration=1.381934499 podStartE2EDuration="19.401855605s" totalImagesPullingTime="18.019921106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:21.401067521 +0000 UTC m=+75.865434250" watchObservedRunningTime="2026-09-10 14:29:21.401855605 +0000 UTC m=+75.866222128"
Sep 10 14:29:21.440503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.440309    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gbp49" podStartSLOduration=2.739457588 podStartE2EDuration="12.440285371s" totalImagesPullingTime="9.700827783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:21.420666338 +0000 UTC m=+75.885032861" watchObservedRunningTime="2026-09-10 14:29:21.440285371 +0000 UTC m=+75.904651894"
Sep 10 14:29:21.770491 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.766375    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"]
Sep 10 14:29:21.795740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.791038    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"]
Sep 10 14:29:21.795740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.791178    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.795740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.794078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 14:29:21.795740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.794336    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hwtvk\""
Sep 10 14:29:21.795740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.794642    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 14:29:21.795740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.795418    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 14:29:21.795740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.795627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 14:29:21.796258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.795840    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 14:29:21.880237 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.880137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da629d35-2a00-471a-a15d-f6c786815341-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.880237 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.880193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9862x\" (UniqueName: \"kubernetes.io/projected/da629d35-2a00-471a-a15d-f6c786815341-kube-api-access-9862x\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.880435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.880272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da629d35-2a00-471a-a15d-f6c786815341-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.880435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.880323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da629d35-2a00-471a-a15d-f6c786815341-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.980735 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.980694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da629d35-2a00-471a-a15d-f6c786815341-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.980863 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.980758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9862x\" (UniqueName: \"kubernetes.io/projected/da629d35-2a00-471a-a15d-f6c786815341-kube-api-access-9862x\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.980863 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.980798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da629d35-2a00-471a-a15d-f6c786815341-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.980863 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.980841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da629d35-2a00-471a-a15d-f6c786815341-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.981925 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.981899    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da629d35-2a00-471a-a15d-f6c786815341-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.990396 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.990344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da629d35-2a00-471a-a15d-f6c786815341-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.990996 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.990954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da629d35-2a00-471a-a15d-f6c786815341-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:21.991896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:21.991847    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9862x\" (UniqueName: \"kubernetes.io/projected/da629d35-2a00-471a-a15d-f6c786815341-kube-api-access-9862x\") pod \"prometheus-operator-6f4946db56-xsjt7\" (UID: \"da629d35-2a00-471a-a15d-f6c786815341\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:22.106370 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:22.106329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"
Sep 10 14:29:22.371340 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:22.370882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6sq6k" event={"ID":"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac","Type":"ContainerStarted","Data":"16db27980976a19fb8439dc99203076dac46f7ef5cf2489c9220f773fe7876fd"}
Sep 10 14:29:22.371340 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:22.370941    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6sq6k" event={"ID":"d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac","Type":"ContainerStarted","Data":"3cbd68898e33b8a076042276b54a9ac6eb83d4cbd6ccbabd9120878ebda817d2"}
Sep 10 14:29:22.389555 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:22.389492    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6sq6k" podStartSLOduration=74.303210567 podStartE2EDuration="1m16.389465893s" totalImagesPullingTime="2.086255326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:22.38760645 +0000 UTC m=+76.851972974" watchObservedRunningTime="2026-09-10 14:29:22.389465893 +0000 UTC m=+76.853832419"
Sep 10 14:29:22.424433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:22.424349    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-xsjt7"]
Sep 10 14:29:22.429883 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:22.429835    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda629d35_2a00_471a_a15d_f6c786815341.slice/crio-a5ac31695aa5309eada478f052da68b4b3539323562e24c5d21ef033e53c3163 WatchSource:0}: Error finding container a5ac31695aa5309eada478f052da68b4b3539323562e24c5d21ef033e53c3163: Status 404 returned error can't find the container with id a5ac31695aa5309eada478f052da68b4b3539323562e24c5d21ef033e53c3163
Sep 10 14:29:23.379452 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:23.379334    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7" event={"ID":"da629d35-2a00-471a-a15d-f6c786815341","Type":"ContainerStarted","Data":"a5ac31695aa5309eada478f052da68b4b3539323562e24c5d21ef033e53c3163"}
Sep 10 14:29:25.255118 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:25.255080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56678d7b8d-wr98f"
Sep 10 14:29:28.192604 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.192460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:28.192604 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.192529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:28.198220 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.198193    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:28.401399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.401352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zcz7q" event={"ID":"fac44fb0-b5fc-45bb-99f1-b4557bd5c67f","Type":"ContainerStarted","Data":"79435040919d4bf8051a34e58ad06c82bff42457763e54cd084c3d17b2045a3d"}
Sep 10 14:29:28.401661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.401453    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:29:28.403237 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.403205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8l7m8" event={"ID":"a2302ed9-18a1-4e02-913d-ff52ce1e809a","Type":"ContainerStarted","Data":"097e423ef82edbc2b2b34104529edbd2e4e4615494e0ae7785e3c2a535a999ff"}
Sep 10 14:29:28.405503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.405476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7" event={"ID":"da629d35-2a00-471a-a15d-f6c786815341","Type":"ContainerStarted","Data":"ac89e8950ed6d2e58b080343ed46b19879efd108cdf0b8407dc1074731d390f8"}
Sep 10 14:29:28.405630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.405523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7" event={"ID":"da629d35-2a00-471a-a15d-f6c786815341","Type":"ContainerStarted","Data":"f561ebf7c813bdc38b2dd834117ea91fa72d9cb6d5f52d3d5b0659bcd35546ac"}
Sep 10 14:29:28.409961 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.409933    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:29:28.419047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.418999    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zcz7q" podStartSLOduration=75.319929366 podStartE2EDuration="1m22.418984577s" totalImagesPullingTime="7.099055211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:28.41790004 +0000 UTC m=+82.882266562" watchObservedRunningTime="2026-09-10 14:29:28.418984577 +0000 UTC m=+82.883351092"
Sep 10 14:29:28.453607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.453505    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8l7m8" podStartSLOduration=74.307960311 podStartE2EDuration="1m22.453487904s" totalImagesPullingTime="8.145527593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:28.451972204 +0000 UTC m=+82.916338738" watchObservedRunningTime="2026-09-10 14:29:28.453487904 +0000 UTC m=+82.917854426"
Sep 10 14:29:28.470383 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.470348    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-598bff97b5-ffskg"]
Sep 10 14:29:28.473508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:28.473448    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-xsjt7" podStartSLOduration=2.204919783 podStartE2EDuration="7.47342962s" totalImagesPullingTime="5.268509837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:28.472847348 +0000 UTC m=+82.937213870" watchObservedRunningTime="2026-09-10 14:29:28.47342962 +0000 UTC m=+82.937796144"
Sep 10 14:29:30.102720 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.102681    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"]
Sep 10 14:29:30.124801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.124766    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"]
Sep 10 14:29:30.125118 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.124873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.127753 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.127728    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 14:29:30.127753 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.127741    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 14:29:30.127946 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.127878    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-n8qbj\""
Sep 10 14:29:30.137542 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.137524    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ls7vq"]
Sep 10 14:29:30.152947 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.152923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.155481 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.155447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vw687\""
Sep 10 14:29:30.155588 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.155511    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 14:29:30.155654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.155600    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 14:29:30.155786 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.155758    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 14:29:30.258174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-tls\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-sys\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5xqx\" (UniqueName: \"kubernetes.io/projected/98c0ac1e-7335-477d-a699-e7adac5024de-kube-api-access-n5xqx\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-wtmp\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/859d2323-78bd-48b4-9efb-b0449ecd17ce-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-textfile\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-root\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98c0ac1e-7335-477d-a699-e7adac5024de-metrics-client-ca\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbxw\" (UniqueName: \"kubernetes.io/projected/859d2323-78bd-48b4-9efb-b0449ecd17ce-kube-api-access-jrbxw\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.258637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.258637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.258637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.258463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-accelerators-collector-config\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-sys\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xqx\" (UniqueName: \"kubernetes.io/projected/98c0ac1e-7335-477d-a699-e7adac5024de-kube-api-access-n5xqx\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-wtmp\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-sys\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/859d2323-78bd-48b4-9efb-b0449ecd17ce-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-textfile\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-root\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98c0ac1e-7335-477d-a699-e7adac5024de-metrics-client-ca\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbxw\" (UniqueName: \"kubernetes.io/projected/859d2323-78bd-48b4-9efb-b0449ecd17ce-kube-api-access-jrbxw\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-wtmp\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.359937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-accelerators-collector-config\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.360423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-tls\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.360423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.359951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98c0ac1e-7335-477d-a699-e7adac5024de-root\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.360423 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:30.360055    2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 14:29:30.360423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.360080    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-textfile\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.360423 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:30.360112    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-tls podName:859d2323-78bd-48b4-9efb-b0449ecd17ce nodeName:}" failed. No retries permitted until 2026-09-10 14:29:30.860093153 +0000 UTC m=+85.324459659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-8kn76" (UID: "859d2323-78bd-48b4-9efb-b0449ecd17ce") : secret "openshift-state-metrics-tls" not found
Sep 10 14:29:30.360423 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:30.360184    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 14:29:30.360423 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:30.360239    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-tls podName:98c0ac1e-7335-477d-a699-e7adac5024de nodeName:}" failed. No retries permitted until 2026-09-10 14:29:30.860217017 +0000 UTC m=+85.324583532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-tls") pod "node-exporter-ls7vq" (UID: "98c0ac1e-7335-477d-a699-e7adac5024de") : secret "node-exporter-tls" not found
Sep 10 14:29:30.360740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.360439    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98c0ac1e-7335-477d-a699-e7adac5024de-metrics-client-ca\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.360740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.360467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-accelerators-collector-config\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.361038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.361013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/859d2323-78bd-48b4-9efb-b0449ecd17ce-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.362291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.362265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.362483 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.362459    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.369788 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.369766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5xqx\" (UniqueName: \"kubernetes.io/projected/98c0ac1e-7335-477d-a699-e7adac5024de-kube-api-access-n5xqx\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.370786 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.370760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbxw\" (UniqueName: \"kubernetes.io/projected/859d2323-78bd-48b4-9efb-b0449ecd17ce-kube-api-access-jrbxw\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.863697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.863660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:30.863943 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.863734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-tls\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.865930 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.865898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98c0ac1e-7335-477d-a699-e7adac5024de-node-exporter-tls\") pod \"node-exporter-ls7vq\" (UID: \"98c0ac1e-7335-477d-a699-e7adac5024de\") " pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:30.866151 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:30.866130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/859d2323-78bd-48b4-9efb-b0449ecd17ce-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-8kn76\" (UID: \"859d2323-78bd-48b4-9efb-b0449ecd17ce\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:31.012426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.012387    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:31.033678 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.033651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"
Sep 10 14:29:31.061868 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.061835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ls7vq"
Sep 10 14:29:31.092797 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:31.092761    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c0ac1e_7335_477d_a699_e7adac5024de.slice/crio-f1f4297fa3bb178d36e0ba87c491d1b57417dd31940797a970e1372ac8e4c795 WatchSource:0}: Error finding container f1f4297fa3bb178d36e0ba87c491d1b57417dd31940797a970e1372ac8e4c795: Status 404 returned error can't find the container with id f1f4297fa3bb178d36e0ba87c491d1b57417dd31940797a970e1372ac8e4c795
Sep 10 14:29:31.185386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.185353    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:29:31.203641 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.203607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.204607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.204585    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:29:31.206896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206295    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mpwxf\""
Sep 10 14:29:31.206896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206535    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 14:29:31.206896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206546    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 14:29:31.206896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 14:29:31.206896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206631    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 14:29:31.206896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206541    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 14:29:31.206896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206882    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 14:29:31.207291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.206918    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 14:29:31.207291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.207069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 14:29:31.215092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.215069    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 14:29:31.267339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-web-config\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-out\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267953 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.267953 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.267836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxn99\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-kube-api-access-wxn99\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.339472 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.339446    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76"]
Sep 10 14:29:31.341345 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:31.341306    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859d2323_78bd_48b4_9efb_b0449ecd17ce.slice/crio-c0088eb14ad8fa0c9d7c9a613eee2f2b6fd821e37daa6af9eebd2300f220c4d0 WatchSource:0}: Error finding container c0088eb14ad8fa0c9d7c9a613eee2f2b6fd821e37daa6af9eebd2300f220c4d0: Status 404 returned error can't find the container with id c0088eb14ad8fa0c9d7c9a613eee2f2b6fd821e37daa6af9eebd2300f220c4d0
Sep 10 14:29:31.368879 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.368825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.368879 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.368874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.368900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369201 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369201 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369201 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:31.369162    2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 10 14:29:31.369201 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn99\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-kube-api-access-wxn99\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369381 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:31.369232    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls podName:6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6 nodeName:}" failed. No retries permitted until 2026-09-10 14:29:31.86920709 +0000 UTC m=+86.333573603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6") : secret "alertmanager-main-tls" not found
Sep 10 14:29:31.369381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-web-config\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369575 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369575 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-out\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.369575 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.369461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.370385 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.370358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.371003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.370599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.371003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.370947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.371944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.371896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.372152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.372131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.372799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.372753    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.373384 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.373175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.373384 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.373340    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.373637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.373612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.374353 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.374333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-web-config\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.374435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.374378    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-out\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.377689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.377670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxn99\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-kube-api-access-wxn99\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.417570 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.417539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ls7vq" event={"ID":"98c0ac1e-7335-477d-a699-e7adac5024de","Type":"ContainerStarted","Data":"f1f4297fa3bb178d36e0ba87c491d1b57417dd31940797a970e1372ac8e4c795"}
Sep 10 14:29:31.418689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.418666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76" event={"ID":"859d2323-78bd-48b4-9efb-b0449ecd17ce","Type":"ContainerStarted","Data":"c0088eb14ad8fa0c9d7c9a613eee2f2b6fd821e37daa6af9eebd2300f220c4d0"}
Sep 10 14:29:31.874217 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.874182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:31.876514 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:31.876490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:32.090114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.090081    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c875498bf-sqjkk"]
Sep 10 14:29:32.115352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.115324    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c875498bf-sqjkk"]
Sep 10 14:29:32.115515 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.115449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.115515 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.115492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:29:32.118311 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.118285    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2e5esohvh67qg\""
Sep 10 14:29:32.118468 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.118350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dbr46\""
Sep 10 14:29:32.118468 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.118285    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 14:29:32.118599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.118582    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 14:29:32.118659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.118617    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 14:29:32.118659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.118628    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 14:29:32.118752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.118582    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 14:29:32.177233 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.177233 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-grpc-tls\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.177444 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.177444 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.177444 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-tls\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.177540 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.177540 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177531    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-metrics-client-ca\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.177600 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.177552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhmn\" (UniqueName: \"kubernetes.io/projected/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-kube-api-access-9nhmn\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-tls\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-metrics-client-ca\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhmn\" (UniqueName: \"kubernetes.io/projected/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-kube-api-access-9nhmn\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.278773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.278627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-grpc-tls\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.279688 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.279613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-metrics-client-ca\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.280970 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.280936    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.281270 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.281243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.281270 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.281264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-grpc-tls\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.281426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.281342    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-tls\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.281426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.281396    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.281426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.281419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.286621 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.286597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhmn\" (UniqueName: \"kubernetes.io/projected/aac20b8f-c737-4a0d-904a-86c9f35c1b3d-kube-api-access-9nhmn\") pod \"thanos-querier-c875498bf-sqjkk\" (UID: \"aac20b8f-c737-4a0d-904a-86c9f35c1b3d\") " pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.423852 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.423815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76" event={"ID":"859d2323-78bd-48b4-9efb-b0449ecd17ce","Type":"ContainerStarted","Data":"f9fa8c49ca2204dca1ce0c846a3ff3f0ddc3748f5a6c745dd445f349c37953c2"}
Sep 10 14:29:32.424052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.423880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76" event={"ID":"859d2323-78bd-48b4-9efb-b0449ecd17ce","Type":"ContainerStarted","Data":"f6fb40bcb56ffe3246054154d58b1e593a0cc85659add54e92d8384f3b1fde95"}
Sep 10 14:29:32.426115 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.426086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:32.426800 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.426779    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:29:32.471299 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:32.471261    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5a44fb_86d5_4b95_8aaf_068bbdc2a1d6.slice/crio-5ce7ebb6be80374ed6618ab744ccc86652cf3e99d667d7c07c7c654d61015818 WatchSource:0}: Error finding container 5ce7ebb6be80374ed6618ab744ccc86652cf3e99d667d7c07c7c654d61015818: Status 404 returned error can't find the container with id 5ce7ebb6be80374ed6618ab744ccc86652cf3e99d667d7c07c7c654d61015818
Sep 10 14:29:32.766483 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:32.766415    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c875498bf-sqjkk"]
Sep 10 14:29:33.020804 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:33.020733    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac20b8f_c737_4a0d_904a_86c9f35c1b3d.slice/crio-7f9c56eed0058789f122b8e0c435ef5bed13f60cdf78713dcc0ec251345d203c WatchSource:0}: Error finding container 7f9c56eed0058789f122b8e0c435ef5bed13f60cdf78713dcc0ec251345d203c: Status 404 returned error can't find the container with id 7f9c56eed0058789f122b8e0c435ef5bed13f60cdf78713dcc0ec251345d203c
Sep 10 14:29:33.429454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:33.429420    2561 generic.go:356] "Generic (PLEG): container finished" podID="98c0ac1e-7335-477d-a699-e7adac5024de" containerID="3ce9f499cbb9cf264a5404b96671717de8cb4a2d4d3c2718efe5dde0fccb05f9" exitCode=0
Sep 10 14:29:33.429888 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:33.429508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ls7vq" event={"ID":"98c0ac1e-7335-477d-a699-e7adac5024de","Type":"ContainerDied","Data":"3ce9f499cbb9cf264a5404b96671717de8cb4a2d4d3c2718efe5dde0fccb05f9"}
Sep 10 14:29:33.430924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:33.430899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerStarted","Data":"5ce7ebb6be80374ed6618ab744ccc86652cf3e99d667d7c07c7c654d61015818"}
Sep 10 14:29:33.432149 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:33.432128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" event={"ID":"aac20b8f-c737-4a0d-904a-86c9f35c1b3d","Type":"ContainerStarted","Data":"7f9c56eed0058789f122b8e0c435ef5bed13f60cdf78713dcc0ec251345d203c"}
Sep 10 14:29:34.427075 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.427035    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"]
Sep 10 14:29:34.453352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.453315    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"]
Sep 10 14:29:34.453352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.453352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ls7vq" event={"ID":"98c0ac1e-7335-477d-a699-e7adac5024de","Type":"ContainerStarted","Data":"803e2821450a0fc77d64f3df428ad9e8f96bb6d3b97e376f795214ab2650218f"}
Sep 10 14:29:34.453810 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.453431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.453810 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.453467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ls7vq" event={"ID":"98c0ac1e-7335-477d-a699-e7adac5024de","Type":"ContainerStarted","Data":"b5c2af792bd80aca031348f34682e125478cf013bbc8201467a837d41f0cf6df"}
Sep 10 14:29:34.453810 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.453495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76" event={"ID":"859d2323-78bd-48b4-9efb-b0449ecd17ce","Type":"ContainerStarted","Data":"eff8ccf2f035ba526e4a24c2566aa66f3e7cb98c466f74feccd08cd18a620a69"}
Sep 10 14:29:34.456223 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.456196    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-80d2k1aggis5o\""
Sep 10 14:29:34.456353 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.456196    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 14:29:34.456353 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.456199    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 14:29:34.457065 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.457046    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rns6t\""
Sep 10 14:29:34.457152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.457074    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 14:29:34.457152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.457049    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 14:29:34.459697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.459657    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ls7vq" podStartSLOduration=2.980653635 podStartE2EDuration="4.459641296s" totalImagesPullingTime="1.3980665s" totalInitContainerRuntime="80.921161ms" isStatefulPod=true podCreationTimestamp="2026-09-10 14:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:34.458249549 +0000 UTC m=+88.922616071" watchObservedRunningTime="2026-09-10 14:29:34.459641296 +0000 UTC m=+88.924007819"
Sep 10 14:29:34.474816 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.474774    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-8kn76" podStartSLOduration=2.676818164 podStartE2EDuration="4.474761379s" totalImagesPullingTime="1.797943215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:34.474541724 +0000 UTC m=+88.938908245" watchObservedRunningTime="2026-09-10 14:29:34.474761379 +0000 UTC m=+88.939127898"
Sep 10 14:29:34.597804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.597768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-client-ca-bundle\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.597975 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.597827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d94a3f8-b314-4365-b8ff-111b1cadc29e-audit-log\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.598078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.598048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-secret-metrics-server-client-certs\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.598145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.598111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d94a3f8-b314-4365-b8ff-111b1cadc29e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.598145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.598138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6gs\" (UniqueName: \"kubernetes.io/projected/0d94a3f8-b314-4365-b8ff-111b1cadc29e-kube-api-access-6k6gs\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.598257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.598202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d94a3f8-b314-4365-b8ff-111b1cadc29e-metrics-server-audit-profiles\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.598309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.598280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-secret-metrics-server-tls\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.699789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d94a3f8-b314-4365-b8ff-111b1cadc29e-metrics-server-audit-profiles\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.699851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-secret-metrics-server-tls\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.699893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-client-ca-bundle\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.699927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d94a3f8-b314-4365-b8ff-111b1cadc29e-audit-log\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.700001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-secret-metrics-server-client-certs\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700446 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.700043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d94a3f8-b314-4365-b8ff-111b1cadc29e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700446 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.700067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gs\" (UniqueName: \"kubernetes.io/projected/0d94a3f8-b314-4365-b8ff-111b1cadc29e-kube-api-access-6k6gs\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.700543 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.700501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d94a3f8-b314-4365-b8ff-111b1cadc29e-audit-log\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.701160 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.701085    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d94a3f8-b314-4365-b8ff-111b1cadc29e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.701293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.701219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d94a3f8-b314-4365-b8ff-111b1cadc29e-metrics-server-audit-profiles\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.702955 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.702916    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-secret-metrics-server-tls\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.703210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.703178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-client-ca-bundle\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.703862 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.703843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d94a3f8-b314-4365-b8ff-111b1cadc29e-secret-metrics-server-client-certs\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.709696 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.709671    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6gs\" (UniqueName: \"kubernetes.io/projected/0d94a3f8-b314-4365-b8ff-111b1cadc29e-kube-api-access-6k6gs\") pod \"metrics-server-7d6895bcbc-9qjcq\" (UID: \"0d94a3f8-b314-4365-b8ff-111b1cadc29e\") " pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.763586 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.763540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:34.911979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.911680    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f887c9ccb-8sktq"]
Sep 10 14:29:34.939343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.939309    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"]
Sep 10 14:29:34.939550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.939458    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:34.960954 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.960887    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"]
Sep 10 14:29:34.960954 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.960931    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f887c9ccb-8sktq"]
Sep 10 14:29:34.961207 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.961011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:34.965113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.965086    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vj989\""
Sep 10 14:29:34.965235 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:34.965207    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 10 14:29:35.104052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-config\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.104246 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-serving-cert\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.104246 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klh2w\" (UniqueName: \"kubernetes.io/projected/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-kube-api-access-klh2w\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.104246 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-trusted-ca-bundle\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.104246 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzcg9\" (UniqueName: \"kubernetes.io/projected/543e1c27-bc2d-476a-bfea-514ada4c0db9-kube-api-access-tzcg9\") pod \"monitoring-plugin-85bbbbbf4-n2s6r\" (UID: \"543e1c27-bc2d-476a-bfea-514ada4c0db9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:35.104431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-oauth-config\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.104431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-oauth-serving-cert\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.104431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/543e1c27-bc2d-476a-bfea-514ada4c0db9-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-n2s6r\" (UID: \"543e1c27-bc2d-476a-bfea-514ada4c0db9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:35.104431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.104379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-service-ca\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.205823 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.205789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-service-ca\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.206015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.205850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-config\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.206015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.205887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-serving-cert\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.206015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.205916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klh2w\" (UniqueName: \"kubernetes.io/projected/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-kube-api-access-klh2w\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.206015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.205972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-trusted-ca-bundle\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.206230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.206027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzcg9\" (UniqueName: \"kubernetes.io/projected/543e1c27-bc2d-476a-bfea-514ada4c0db9-kube-api-access-tzcg9\") pod \"monitoring-plugin-85bbbbbf4-n2s6r\" (UID: \"543e1c27-bc2d-476a-bfea-514ada4c0db9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:35.206230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.206057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-oauth-config\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.206230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.206114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-oauth-serving-cert\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.206230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.206148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/543e1c27-bc2d-476a-bfea-514ada4c0db9-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-n2s6r\" (UID: \"543e1c27-bc2d-476a-bfea-514ada4c0db9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:35.207076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.206888    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-config\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.207076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.206938    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-oauth-serving-cert\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.207272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.207249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-trusted-ca-bundle\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.208778 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.208727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-service-ca\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.208969 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.208949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-serving-cert\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.209038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.208986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/543e1c27-bc2d-476a-bfea-514ada4c0db9-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-n2s6r\" (UID: \"543e1c27-bc2d-476a-bfea-514ada4c0db9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:35.209587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.209545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-oauth-config\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.213911 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.213858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzcg9\" (UniqueName: \"kubernetes.io/projected/543e1c27-bc2d-476a-bfea-514ada4c0db9-kube-api-access-tzcg9\") pod \"monitoring-plugin-85bbbbbf4-n2s6r\" (UID: \"543e1c27-bc2d-476a-bfea-514ada4c0db9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:35.214153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.214133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klh2w\" (UniqueName: \"kubernetes.io/projected/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-kube-api-access-klh2w\") pod \"console-5f887c9ccb-8sktq\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") " pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.252134 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.252107    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:35.271037 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.271008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:35.323024 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.322978    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9cc97b99-4fpx4"]
Sep 10 14:29:35.358184 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.357643    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9cc97b99-4fpx4"]
Sep 10 14:29:35.358184 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.357808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.361144 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.361115    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 14:29:35.361268 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.361228    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 14:29:35.361268 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.361228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 14:29:35.361348 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.361319    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 14:29:35.361659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.361629    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wm25t\""
Sep 10 14:29:35.361720 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.361677    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 14:29:35.367605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.367556    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 14:29:35.445967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.445934    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerID="6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f" exitCode=0
Sep 10 14:29:35.446137 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.446023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f"}
Sep 10 14:29:35.508637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sc2g\" (UniqueName: \"kubernetes.io/projected/c78c6286-de06-4ee1-94fd-49ad8b251fcb-kube-api-access-2sc2g\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.508637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-telemeter-client-tls\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.509041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-secret-telemeter-client\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.509041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508740    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-federate-client-tls\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.509041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.509041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.509041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-serving-certs-ca-bundle\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.509041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.508890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-metrics-client-ca\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.514947 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.514917    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"]
Sep 10 14:29:35.569213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.569180    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f887c9ccb-8sktq"]
Sep 10 14:29:35.597142 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.597111    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"]
Sep 10 14:29:35.609667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.609640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sc2g\" (UniqueName: \"kubernetes.io/projected/c78c6286-de06-4ee1-94fd-49ad8b251fcb-kube-api-access-2sc2g\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.609802 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.609752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-telemeter-client-tls\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.610138 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.610111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-secret-telemeter-client\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.610232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.610154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-federate-client-tls\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.610232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.610185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.610344 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.610247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.610344 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.610299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-serving-certs-ca-bundle\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.610449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.610366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-metrics-client-ca\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.611354 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.611288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-metrics-client-ca\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.611492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.611406    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-serving-certs-ca-bundle\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.611543 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.611492    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78c6286-de06-4ee1-94fd-49ad8b251fcb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.612949 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.612922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-telemeter-client-tls\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.613062 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.613041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-federate-client-tls\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.613105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.613041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-secret-telemeter-client\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.613105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.613052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c78c6286-de06-4ee1-94fd-49ad8b251fcb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.618140 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.618120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sc2g\" (UniqueName: \"kubernetes.io/projected/c78c6286-de06-4ee1-94fd-49ad8b251fcb-kube-api-access-2sc2g\") pod \"telemeter-client-9cc97b99-4fpx4\" (UID: \"c78c6286-de06-4ee1-94fd-49ad8b251fcb\") " pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.670209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.670182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4"
Sep 10 14:29:35.690570 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:35.690531    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d94a3f8_b314_4365_b8ff_111b1cadc29e.slice/crio-19c55c2b9b7d3b0497cfca880582d186c62a72d8e14eb04ed697d3799bbc8617 WatchSource:0}: Error finding container 19c55c2b9b7d3b0497cfca880582d186c62a72d8e14eb04ed697d3799bbc8617: Status 404 returned error can't find the container with id 19c55c2b9b7d3b0497cfca880582d186c62a72d8e14eb04ed697d3799bbc8617
Sep 10 14:29:35.691385 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:35.691274    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ab12b6_b4b5_41d8_9bca_2e19bc6343a3.slice/crio-9517c74bbd4c90794542afc7b57dc2e2b9c56256d9e84ce27c8922de8ce5b2f4 WatchSource:0}: Error finding container 9517c74bbd4c90794542afc7b57dc2e2b9c56256d9e84ce27c8922de8ce5b2f4: Status 404 returned error can't find the container with id 9517c74bbd4c90794542afc7b57dc2e2b9c56256d9e84ce27c8922de8ce5b2f4
Sep 10 14:29:35.692584 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:35.692463    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543e1c27_bc2d_476a_bfea_514ada4c0db9.slice/crio-3b8be58c2c0fb4c15b75f719113c79ef2e9b14aeb1fcab35addd2ad10263eb3d WatchSource:0}: Error finding container 3b8be58c2c0fb4c15b75f719113c79ef2e9b14aeb1fcab35addd2ad10263eb3d: Status 404 returned error can't find the container with id 3b8be58c2c0fb4c15b75f719113c79ef2e9b14aeb1fcab35addd2ad10263eb3d
Sep 10 14:29:35.996486 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:35.996457    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9cc97b99-4fpx4"]
Sep 10 14:29:35.999251 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:35.999219    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78c6286_de06_4ee1_94fd_49ad8b251fcb.slice/crio-9fc7668b440ad4d24076328b75520a920957d78a0b4e9ee2fa1942ea832c3219 WatchSource:0}: Error finding container 9fc7668b440ad4d24076328b75520a920957d78a0b4e9ee2fa1942ea832c3219: Status 404 returned error can't find the container with id 9fc7668b440ad4d24076328b75520a920957d78a0b4e9ee2fa1942ea832c3219
Sep 10 14:29:36.382422 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.379612    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:29:36.401036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.400991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.403312 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.403280    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:29:36.410655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.408277    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 14:29:36.410655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.408548    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 14:29:36.410655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.409304    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jcm9t\""
Sep 10 14:29:36.410655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.409578    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 14:29:36.410655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.409895    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 14:29:36.410655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.410092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 14:29:36.414195 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.410418    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 14:29:36.414195 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.410468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6r2okg9iugck7\""
Sep 10 14:29:36.414195 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.413605    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 14:29:36.414195 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.411378    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 14:29:36.414539 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.411318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 14:29:36.423240 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.422490    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 14:29:36.425829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.425592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 14:29:36.430558 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.427368    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 14:29:36.430558 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.427423    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 14:29:36.432047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.432006    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 14:29:36.458022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.457938    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" event={"ID":"aac20b8f-c737-4a0d-904a-86c9f35c1b3d","Type":"ContainerStarted","Data":"eeb5f1d83646c97232df933035a312e00bc1380f59c5165121ceb56c50a2bcc5"}
Sep 10 14:29:36.458221 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.458120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" event={"ID":"aac20b8f-c737-4a0d-904a-86c9f35c1b3d","Type":"ContainerStarted","Data":"67b486e85d6f113b5817b011df2d5c94c37a1022439003b88544d8a68637d0ff"}
Sep 10 14:29:36.458221 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.458171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" event={"ID":"aac20b8f-c737-4a0d-904a-86c9f35c1b3d","Type":"ContainerStarted","Data":"6e6c5876335d370ab56b5290fe9830bc504a6b042c2694ff570e0771e5ee5edd"}
Sep 10 14:29:36.459752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.459718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r" event={"ID":"543e1c27-bc2d-476a-bfea-514ada4c0db9","Type":"ContainerStarted","Data":"3b8be58c2c0fb4c15b75f719113c79ef2e9b14aeb1fcab35addd2ad10263eb3d"}
Sep 10 14:29:36.461295 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.461256    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq" event={"ID":"0d94a3f8-b314-4365-b8ff-111b1cadc29e","Type":"ContainerStarted","Data":"19c55c2b9b7d3b0497cfca880582d186c62a72d8e14eb04ed697d3799bbc8617"}
Sep 10 14:29:36.465935 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.465786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f887c9ccb-8sktq" event={"ID":"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3","Type":"ContainerStarted","Data":"83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8"}
Sep 10 14:29:36.465935 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.465841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f887c9ccb-8sktq" event={"ID":"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3","Type":"ContainerStarted","Data":"9517c74bbd4c90794542afc7b57dc2e2b9c56256d9e84ce27c8922de8ce5b2f4"}
Sep 10 14:29:36.467966 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.467941    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4" event={"ID":"c78c6286-de06-4ee1-94fd-49ad8b251fcb","Type":"ContainerStarted","Data":"9fc7668b440ad4d24076328b75520a920957d78a0b4e9ee2fa1942ea832c3219"}
Sep 10 14:29:36.487721 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.487657    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f887c9ccb-8sktq" podStartSLOduration=2.487636746 podStartE2EDuration="2.487636746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:36.487046621 +0000 UTC m=+90.951413145" watchObservedRunningTime="2026-09-10 14:29:36.487636746 +0000 UTC m=+90.952003268"
Sep 10 14:29:36.530679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.530679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530613    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.530679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530643    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.530679 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-config\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530894    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.530954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvpk\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-kube-api-access-4fvpk\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.531649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.531410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvpk\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-kube-api-access-4fvpk\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.632977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-config\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.634799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.635756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.635756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.635756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.633347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.635756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.634766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.635756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.635399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.635756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.635621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.636845 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.636232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.638358 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.637414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.638358 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.637626    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.638529 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.638429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.639462 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.639417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.640922 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.640878    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.643859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.643811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.643859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.643826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.646244 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.646219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.647768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.647724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.647931 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.647907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.650174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.650131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.650745 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.650687    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.651200 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.651061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.651200 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.651174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.651801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.651782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-config\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.653958 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.653913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvpk\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-kube-api-access-4fvpk\") pod \"prometheus-k8s-0\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:36.732942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:36.732625    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:37.079135 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:37.079103    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:29:37.253941 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:37.253903    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab41057_afe2_4f80_a4de_e22992cec623.slice/crio-a5bcc372762bf303fab6672ee533419dd572241c49e6356072637ebf3415d8e6 WatchSource:0}: Error finding container a5bcc372762bf303fab6672ee533419dd572241c49e6356072637ebf3415d8e6: Status 404 returned error can't find the container with id a5bcc372762bf303fab6672ee533419dd572241c49e6356072637ebf3415d8e6
Sep 10 14:29:37.474599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:37.474551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerStarted","Data":"a5bcc372762bf303fab6672ee533419dd572241c49e6356072637ebf3415d8e6"}
Sep 10 14:29:40.493057 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.493022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerStarted","Data":"6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830"}
Sep 10 14:29:40.493468 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.493112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerStarted","Data":"60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe"}
Sep 10 14:29:40.495698 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.495665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4" event={"ID":"c78c6286-de06-4ee1-94fd-49ad8b251fcb","Type":"ContainerStarted","Data":"117b70864df0d8a8ae0768d076f9b37db03e50e77192206bbdd5a93b6bb60fdd"}
Sep 10 14:29:40.495866 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.495751    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4" event={"ID":"c78c6286-de06-4ee1-94fd-49ad8b251fcb","Type":"ContainerStarted","Data":"1c257a275ee6421030453a43f46ba2c101f5a8f532c5cf9f96ea2f8e62826620"}
Sep 10 14:29:40.498301 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.498274    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab41057-afe2-4f80-a4de-e22992cec623" containerID="ad4cc20fe68750eb1c182331f66c35a38cf61cdcf4b02a594b30094f34be8958" exitCode=0
Sep 10 14:29:40.498400 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.498385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"ad4cc20fe68750eb1c182331f66c35a38cf61cdcf4b02a594b30094f34be8958"}
Sep 10 14:29:40.502337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.502310    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" event={"ID":"aac20b8f-c737-4a0d-904a-86c9f35c1b3d","Type":"ContainerStarted","Data":"dee460c274d949b87001491f860ea1c3e614f86c3afbde7bbaa1c0559b514f5a"}
Sep 10 14:29:40.502429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.502381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" event={"ID":"aac20b8f-c737-4a0d-904a-86c9f35c1b3d","Type":"ContainerStarted","Data":"875dcdee47e1288d65eb2d383a5d46d4cff2dc5be125c71a7941681ee3dfc985"}
Sep 10 14:29:40.502429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.502423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" event={"ID":"aac20b8f-c737-4a0d-904a-86c9f35c1b3d","Type":"ContainerStarted","Data":"961498dfa6e7d8162ddadfdea6ab115f8f15dfedf2c70210bfdba4871c7ca52a"}
Sep 10 14:29:40.502973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.502919    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:40.506397 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.506371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r" event={"ID":"543e1c27-bc2d-476a-bfea-514ada4c0db9","Type":"ContainerStarted","Data":"70edecbd546cc673a804e1d876494c1c313c728f527e717bce4199c903c637f7"}
Sep 10 14:29:40.508787 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.508759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq" event={"ID":"0d94a3f8-b314-4365-b8ff-111b1cadc29e","Type":"ContainerStarted","Data":"d015ec0dae5a053e9b27b2e016ef6e3d7436ee8fa3e02896323faf09fbc262e5"}
Sep 10 14:29:40.511065 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.511047    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk"
Sep 10 14:29:40.526036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.525936    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:40.532462 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.532441    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r"
Sep 10 14:29:40.550436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.550383    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c875498bf-sqjkk" podStartSLOduration=2.136469661 podStartE2EDuration="8.550362068s" totalImagesPullingTime="6.413892407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:40.550145316 +0000 UTC m=+95.014511841" watchObservedRunningTime="2026-09-10 14:29:40.550362068 +0000 UTC m=+95.014728591"
Sep 10 14:29:40.571539 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.571483    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq" podStartSLOduration=2.455687629 podStartE2EDuration="6.571462201s" totalImagesPullingTime="4.115774572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:40.568984037 +0000 UTC m=+95.033350563" watchObservedRunningTime="2026-09-10 14:29:40.571462201 +0000 UTC m=+95.035828724"
Sep 10 14:29:40.588772 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:40.588713    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-n2s6r" podStartSLOduration=2.472869925 podStartE2EDuration="6.588679054s" totalImagesPullingTime="4.115809129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:40.588200757 +0000 UTC m=+95.052567284" watchObservedRunningTime="2026-09-10 14:29:40.588679054 +0000 UTC m=+95.053045577"
Sep 10 14:29:41.518635 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.518589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4" event={"ID":"c78c6286-de06-4ee1-94fd-49ad8b251fcb","Type":"ContainerStarted","Data":"29efc82398cbedf2a96ab435a82fec3a5798036ebdf1fdcb671824d5f6d3a27f"}
Sep 10 14:29:41.524655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.524212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerStarted","Data":"4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8"}
Sep 10 14:29:41.524655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.524290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerStarted","Data":"b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62"}
Sep 10 14:29:41.524655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.524328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerStarted","Data":"9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab"}
Sep 10 14:29:41.524655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.524364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerStarted","Data":"72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b"}
Sep 10 14:29:41.547983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.547887    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9cc97b99-4fpx4" podStartSLOduration=2.356847095 podStartE2EDuration="6.547864672s" totalImagesPullingTime="4.191017577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:41.544515587 +0000 UTC m=+96.008882126" watchObservedRunningTime="2026-09-10 14:29:41.547864672 +0000 UTC m=+96.012231208"
Sep 10 14:29:41.574034 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.572385    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.6501834669999997 podStartE2EDuration="10.572362194s" totalImagesPullingTime="6.898265059s" totalInitContainerRuntime="23.913668ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:41.569936335 +0000 UTC m=+96.034302879" watchObservedRunningTime="2026-09-10 14:29:41.572362194 +0000 UTC m=+96.036728720"
Sep 10 14:29:41.644656 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.644619    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f887c9ccb-8sktq"]
Sep 10 14:29:41.672018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.671982    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d4b56554-w7r64"]
Sep 10 14:29:41.691303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.691278    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4b56554-w7r64"]
Sep 10 14:29:41.691461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.691369    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.888526 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.888437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-serving-cert\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.888792 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.888530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-oauth-config\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.888792 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.888555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-trusted-ca-bundle\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.888792 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.888624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-oauth-serving-cert\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.888792 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.888660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-config\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.888792 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.888696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqc7r\" (UniqueName: \"kubernetes.io/projected/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-kube-api-access-tqc7r\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.889056 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.888809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-service-ca\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-service-ca\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-serving-cert\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-oauth-config\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-trusted-ca-bundle\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-oauth-serving-cert\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990275    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-config\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqc7r\" (UniqueName: \"kubernetes.io/projected/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-kube-api-access-tqc7r\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.990955 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990926    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-service-ca\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.991085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.990993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-oauth-serving-cert\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.991154 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.991103    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-trusted-ca-bundle\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.991253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.991235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-config\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.993876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.993846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-oauth-config\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:41.994060 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:41.994036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-serving-cert\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:42.005907 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:42.005884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqc7r\" (UniqueName: \"kubernetes.io/projected/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-kube-api-access-tqc7r\") pod \"console-86d4b56554-w7r64\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") " pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:42.306459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:42.305183    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:42.622753 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:42.622647    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4b56554-w7r64"]
Sep 10 14:29:42.631715 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:29:42.631676    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe0b337_bdd5_4f65_a8f1_aa72fba1904c.slice/crio-b5d3bf1bea0da0b11b228c34fcf2acf6623636900ab3ce5779381be56a1fa370 WatchSource:0}: Error finding container b5d3bf1bea0da0b11b228c34fcf2acf6623636900ab3ce5779381be56a1fa370: Status 404 returned error can't find the container with id b5d3bf1bea0da0b11b228c34fcf2acf6623636900ab3ce5779381be56a1fa370
Sep 10 14:29:43.539071 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:43.539032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b56554-w7r64" event={"ID":"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c","Type":"ContainerStarted","Data":"bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474"}
Sep 10 14:29:43.539256 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:43.539092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b56554-w7r64" event={"ID":"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c","Type":"ContainerStarted","Data":"b5d3bf1bea0da0b11b228c34fcf2acf6623636900ab3ce5779381be56a1fa370"}
Sep 10 14:29:43.559145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:43.559083    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d4b56554-w7r64" podStartSLOduration=2.559065936 podStartE2EDuration="2.559065936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:43.556947972 +0000 UTC m=+98.021314495" watchObservedRunningTime="2026-09-10 14:29:43.559065936 +0000 UTC m=+98.023432459"
Sep 10 14:29:44.549252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:44.549208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerStarted","Data":"dabeba2f7ea6ee30615643fb5b215e797b6bc73b46c21a1304ddc8bba81e90d6"}
Sep 10 14:29:44.549773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:44.549284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerStarted","Data":"7c48507232aeb936aea7b5e4ee3b71337bc025877146fc9f830a042f0168a932"}
Sep 10 14:29:45.252794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:45.252755    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:29:45.557889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:45.557803    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerStarted","Data":"dc879e59b1b3e808391bd39fabe44ba30a0821357f137fe3c599d4b3558fedd1"}
Sep 10 14:29:45.557889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:45.557875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerStarted","Data":"21fe5b8c2174f207ab3ffd9478b4e984aabe9d87ebdad0594bd5c3cb3101d974"}
Sep 10 14:29:45.558340 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:45.557906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerStarted","Data":"b76d90bcf57c61675746f5f96f5b80a5fb69c3800421b855ff43c1d39629d6d3"}
Sep 10 14:29:45.558340 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:45.557932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerStarted","Data":"3aa05750dac578884ed825424d7324979be7d29d2df26e1ea752df6458b2fc41"}
Sep 10 14:29:45.591052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:45.590992    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.792258788 podStartE2EDuration="9.590973393s" totalImagesPullingTime="3.777382766s" totalInitContainerRuntime="21.331839ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:45.588582359 +0000 UTC m=+100.052948891" watchObservedRunningTime="2026-09-10 14:29:45.590973393 +0000 UTC m=+100.055339915"
Sep 10 14:29:46.733415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:46.733377    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:52.305622 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:52.305583    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:52.306123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:52.305646    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:52.310505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:52.310480    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:52.596089 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:52.596007    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:29:52.649770 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:52.649689    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858d4bd764-7mzsm"]
Sep 10 14:29:53.494948 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.494887    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-598bff97b5-ffskg" podUID="02c83545-a2f6-4aef-9f9a-14745b3892ac" containerName="console" containerID="cri-o://c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd" gracePeriod=15
Sep 10 14:29:53.776347 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.776273    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:53.807230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807193    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-oauth-serving-cert\") pod \"02c83545-a2f6-4aef-9f9a-14745b3892ac\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") "
Sep 10 14:29:53.807405 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807263    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-config\") pod \"02c83545-a2f6-4aef-9f9a-14745b3892ac\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") "
Sep 10 14:29:53.807405 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807309    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-service-ca\") pod \"02c83545-a2f6-4aef-9f9a-14745b3892ac\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") "
Sep 10 14:29:53.807405 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-oauth-config\") pod \"02c83545-a2f6-4aef-9f9a-14745b3892ac\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") "
Sep 10 14:29:53.807405 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807388    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-serving-cert\") pod \"02c83545-a2f6-4aef-9f9a-14745b3892ac\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") "
Sep 10 14:29:53.807618 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7jh9\" (UniqueName: \"kubernetes.io/projected/02c83545-a2f6-4aef-9f9a-14745b3892ac-kube-api-access-q7jh9\") pod \"02c83545-a2f6-4aef-9f9a-14745b3892ac\" (UID: \"02c83545-a2f6-4aef-9f9a-14745b3892ac\") "
Sep 10 14:29:53.807669 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807641    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02c83545-a2f6-4aef-9f9a-14745b3892ac" (UID: "02c83545-a2f6-4aef-9f9a-14745b3892ac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:29:53.807740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-config" (OuterVolumeSpecName: "console-config") pod "02c83545-a2f6-4aef-9f9a-14745b3892ac" (UID: "02c83545-a2f6-4aef-9f9a-14745b3892ac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:29:53.807856 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807834    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:29:53.807923 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807861    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:29:53.807923 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.807870    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-service-ca" (OuterVolumeSpecName: "service-ca") pod "02c83545-a2f6-4aef-9f9a-14745b3892ac" (UID: "02c83545-a2f6-4aef-9f9a-14745b3892ac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:29:53.809921 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.809889    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02c83545-a2f6-4aef-9f9a-14745b3892ac" (UID: "02c83545-a2f6-4aef-9f9a-14745b3892ac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:29:53.809921 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.809909    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c83545-a2f6-4aef-9f9a-14745b3892ac-kube-api-access-q7jh9" (OuterVolumeSpecName: "kube-api-access-q7jh9") pod "02c83545-a2f6-4aef-9f9a-14745b3892ac" (UID: "02c83545-a2f6-4aef-9f9a-14745b3892ac"). InnerVolumeSpecName "kube-api-access-q7jh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:29:53.810051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.809948    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02c83545-a2f6-4aef-9f9a-14745b3892ac" (UID: "02c83545-a2f6-4aef-9f9a-14745b3892ac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:29:53.908719 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.908663    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02c83545-a2f6-4aef-9f9a-14745b3892ac-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:29:53.908719 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.908696    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:29:53.908719 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.908723    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02c83545-a2f6-4aef-9f9a-14745b3892ac-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:29:53.909000 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:53.908732    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7jh9\" (UniqueName: \"kubernetes.io/projected/02c83545-a2f6-4aef-9f9a-14745b3892ac-kube-api-access-q7jh9\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:29:54.603151 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.603115    2561 generic.go:356] "Generic (PLEG): container finished" podID="02c83545-a2f6-4aef-9f9a-14745b3892ac" containerID="c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd" exitCode=0
Sep 10 14:29:54.603620 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.603156    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598bff97b5-ffskg"
Sep 10 14:29:54.603620 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.603177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598bff97b5-ffskg" event={"ID":"02c83545-a2f6-4aef-9f9a-14745b3892ac","Type":"ContainerDied","Data":"c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd"}
Sep 10 14:29:54.603620 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.603227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598bff97b5-ffskg" event={"ID":"02c83545-a2f6-4aef-9f9a-14745b3892ac","Type":"ContainerDied","Data":"fe748ac175eb91e52b5efaadd619042e4f65d5219dad46f81d6beb130459dde4"}
Sep 10 14:29:54.603620 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.603255    2561 scope.go:117] "RemoveContainer" containerID="c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd"
Sep 10 14:29:54.620174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.620144    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-598bff97b5-ffskg"]
Sep 10 14:29:54.621078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.621063    2561 scope.go:117] "RemoveContainer" containerID="c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd"
Sep 10 14:29:54.621413 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:29:54.621391    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd\": container with ID starting with c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd not found: ID does not exist" containerID="c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd"
Sep 10 14:29:54.621482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.621427    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd"} err="failed to get container status \"c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd\": rpc error: code = NotFound desc = could not find container \"c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd\": container with ID starting with c4884f57ff19ae9a3b890154634ca05ae8d26d65c949a56823170a08ef418acd not found: ID does not exist"
Sep 10 14:29:54.624138 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.624116    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-598bff97b5-ffskg"]
Sep 10 14:29:54.763680 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.763644    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:54.763898 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:54.763733    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:29:55.995337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:55.995302    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02c83545-a2f6-4aef-9f9a-14745b3892ac" path="/var/lib/kubelet/pods/02c83545-a2f6-4aef-9f9a-14745b3892ac/volumes"
Sep 10 14:29:59.412983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:29:59.412946    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zcz7q"
Sep 10 14:30:06.664354 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:06.664310    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f887c9ccb-8sktq" podUID="26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" containerName="console" containerID="cri-o://83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8" gracePeriod=15
Sep 10 14:30:06.947164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:06.947075    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:30:07.030605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.030572    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-trusted-ca-bundle\") pod \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") "
Sep 10 14:30:07.030796 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.030663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-config\") pod \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") "
Sep 10 14:30:07.030843 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.030779    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klh2w\" (UniqueName: \"kubernetes.io/projected/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-kube-api-access-klh2w\") pod \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") "
Sep 10 14:30:07.030879 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.030866    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-service-ca\") pod \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") "
Sep 10 14:30:07.030933 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.030917    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-oauth-config\") pod \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") "
Sep 10 14:30:07.030977 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.030966    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-serving-cert\") pod \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") "
Sep 10 14:30:07.031019 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.030994    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-oauth-serving-cert\") pod \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\" (UID: \"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3\") "
Sep 10 14:30:07.031069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.031028    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" (UID: "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:07.031123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.031078    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-config" (OuterVolumeSpecName: "console-config") pod "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" (UID: "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:07.031494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.031351    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" (UID: "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:07.031494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.031407    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" (UID: "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:07.031494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.031435    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:07.031494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.031457    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:07.031494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.031470    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:07.033011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.032986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-kube-api-access-klh2w" (OuterVolumeSpecName: "kube-api-access-klh2w") pod "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" (UID: "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3"). InnerVolumeSpecName "kube-api-access-klh2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:07.033509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.033477    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" (UID: "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:07.033509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.033486    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" (UID: "26ab12b6-b4b5-41d8-9bca-2e19bc6343a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:07.132143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.132099    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klh2w\" (UniqueName: \"kubernetes.io/projected/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-kube-api-access-klh2w\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:07.132143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.132134    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:07.132143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.132143    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:07.132143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.132155    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:07.669252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.669213    2561 generic.go:356] "Generic (PLEG): container finished" podID="26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" containerID="83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8" exitCode=0
Sep 10 14:30:07.669727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.669270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f887c9ccb-8sktq" event={"ID":"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3","Type":"ContainerDied","Data":"83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8"}
Sep 10 14:30:07.669727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.669319    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f887c9ccb-8sktq" event={"ID":"26ab12b6-b4b5-41d8-9bca-2e19bc6343a3","Type":"ContainerDied","Data":"9517c74bbd4c90794542afc7b57dc2e2b9c56256d9e84ce27c8922de8ce5b2f4"}
Sep 10 14:30:07.669727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.669346    2561 scope.go:117] "RemoveContainer" containerID="83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8"
Sep 10 14:30:07.669727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.669270    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f887c9ccb-8sktq"
Sep 10 14:30:07.679027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.679007    2561 scope.go:117] "RemoveContainer" containerID="83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8"
Sep 10 14:30:07.679339 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:07.679315    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8\": container with ID starting with 83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8 not found: ID does not exist" containerID="83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8"
Sep 10 14:30:07.679431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.679348    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8"} err="failed to get container status \"83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8\": rpc error: code = NotFound desc = could not find container \"83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8\": container with ID starting with 83f750d4f21dd8a43b8eb5fa030cd1294f50929ef935a8bcf04838124a1d8fb8 not found: ID does not exist"
Sep 10 14:30:07.691113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.691087    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f887c9ccb-8sktq"]
Sep 10 14:30:07.694937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.694915    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f887c9ccb-8sktq"]
Sep 10 14:30:07.992671 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:07.992592    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" path="/var/lib/kubelet/pods/26ab12b6-b4b5-41d8-9bca-2e19bc6343a3/volumes"
Sep 10 14:30:14.769433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:14.769403    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:30:14.773156 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:14.773131    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d6895bcbc-9qjcq"
Sep 10 14:30:17.670454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:17.670407    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-858d4bd764-7mzsm" podUID="71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" containerName="console" containerID="cri-o://34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066" gracePeriod=15
Sep 10 14:30:17.969894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:17.969851    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:30:18.042431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.042402    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5xdp\" (UniqueName: \"kubernetes.io/projected/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-kube-api-access-q5xdp\") pod \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") "
Sep 10 14:30:18.042616 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.042455    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-oauth-config\") pod \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") "
Sep 10 14:30:18.042616 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.042479    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-service-ca\") pod \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") "
Sep 10 14:30:18.042616 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.042515    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-oauth-serving-cert\") pod \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") "
Sep 10 14:30:18.042616 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.042541    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-trusted-ca-bundle\") pod \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") "
Sep 10 14:30:18.042947 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.042911    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" (UID: "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:18.043153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.043104    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" (UID: "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:18.043153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.043131    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" (UID: "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:18.044907 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.044882    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-kube-api-access-q5xdp" (OuterVolumeSpecName: "kube-api-access-q5xdp") pod "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" (UID: "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec"). InnerVolumeSpecName "kube-api-access-q5xdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:18.045047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.045024    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" (UID: "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:18.143104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143066    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-config\") pod \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") "
Sep 10 14:30:18.143290 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-serving-cert\") pod \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\" (UID: \"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec\") "
Sep 10 14:30:18.143364 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143333    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5xdp\" (UniqueName: \"kubernetes.io/projected/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-kube-api-access-q5xdp\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.143364 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143352    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.143464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143367    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.143464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143383    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.143464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143396    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.143464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.143434    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-config" (OuterVolumeSpecName: "console-config") pod "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" (UID: "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:18.145512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.145481    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" (UID: "71874a96-f6e5-40d5-a2aa-d43b6dcf32ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:18.243956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.243865    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.243956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.243899    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.723832 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.723796    2561 generic.go:356] "Generic (PLEG): container finished" podID="71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" containerID="34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066" exitCode=0
Sep 10 14:30:18.724288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.723848    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858d4bd764-7mzsm"
Sep 10 14:30:18.724288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.723878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d4bd764-7mzsm" event={"ID":"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec","Type":"ContainerDied","Data":"34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066"}
Sep 10 14:30:18.724288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.723939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858d4bd764-7mzsm" event={"ID":"71874a96-f6e5-40d5-a2aa-d43b6dcf32ec","Type":"ContainerDied","Data":"4b9dbb6c631dea3aafe9143b77b8f2c0864e5c75ebdfc32c3296d11b89ca5be8"}
Sep 10 14:30:18.724288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.723970    2561 scope.go:117] "RemoveContainer" containerID="34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066"
Sep 10 14:30:18.733304 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.733278    2561 scope.go:117] "RemoveContainer" containerID="34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066"
Sep 10 14:30:18.733685 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:18.733657    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066\": container with ID starting with 34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066 not found: ID does not exist" containerID="34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066"
Sep 10 14:30:18.733831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.733696    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066"} err="failed to get container status \"34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066\": rpc error: code = NotFound desc = could not find container \"34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066\": container with ID starting with 34f8fd2c2e4cb8ac6a752af892d8692f79d0bb0a3ba04bba16d914ecad343066 not found: ID does not exist"
Sep 10 14:30:18.751852 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.751812    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858d4bd764-7mzsm"]
Sep 10 14:30:18.753506 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:18.753480    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-858d4bd764-7mzsm"]
Sep 10 14:30:19.992694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:19.992664    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" path="/var/lib/kubelet/pods/71874a96-f6e5-40d5-a2aa-d43b6dcf32ec/volumes"
Sep 10 14:30:36.734103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:36.734046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:36.753450 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:36.753419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:36.828175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:36.828141    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:50.512656 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.512619    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:30:50.513159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.512931    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="alertmanager" containerID="cri-o://60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe" gracePeriod=120
Sep 10 14:30:50.513159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.513000    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-web" containerID="cri-o://72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b" gracePeriod=120
Sep 10 14:30:50.513159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.512991    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-metric" containerID="cri-o://b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62" gracePeriod=120
Sep 10 14:30:50.513159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.513023    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="config-reloader" containerID="cri-o://6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830" gracePeriod=120
Sep 10 14:30:50.513159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.513024    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy" containerID="cri-o://9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab" gracePeriod=120
Sep 10 14:30:50.513159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.513119    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="prom-label-proxy" containerID="cri-o://4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8" gracePeriod=120
Sep 10 14:30:50.879423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879329    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerID="4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8" exitCode=0
Sep 10 14:30:50.879423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879356    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerID="b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62" exitCode=0
Sep 10 14:30:50.879423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879367    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerID="9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab" exitCode=0
Sep 10 14:30:50.879423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879375    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerID="6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830" exitCode=0
Sep 10 14:30:50.879423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879382    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerID="60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe" exitCode=0
Sep 10 14:30:50.879423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8"}
Sep 10 14:30:50.879738 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62"}
Sep 10 14:30:50.879738 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab"}
Sep 10 14:30:50.879738 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830"}
Sep 10 14:30:50.879738 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:50.879544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe"}
Sep 10 14:30:51.759333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.759308    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:51.832673 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832642    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.832877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832723    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.832877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832762    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-web-config\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.832877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-main-db\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.832877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832801    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.832877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832815    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-volume\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832887    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-out\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832914    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-metrics-client-ca\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832939    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-cluster-tls-config\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832969    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.832999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxn99\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-kube-api-access-wxn99\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.833030    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-tls-assets\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.833078    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-trusted-ca-bundle\") pod \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\" (UID: \"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6\") "
Sep 10 14:30:51.833153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.833121    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:30:51.833633 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.833390    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-main-db\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.834074 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.833994    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:51.834241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.834213    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:51.837249 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.836248    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:51.837249 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.836353    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-volume" (OuterVolumeSpecName: "config-volume") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:51.837249 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.836439    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:51.837249 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.836617    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-kube-api-access-wxn99" (OuterVolumeSpecName: "kube-api-access-wxn99") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "kube-api-access-wxn99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:51.837249 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.836890    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-out" (OuterVolumeSpecName: "config-out") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:30:51.837521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.837284    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:51.837672 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.837652    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:51.838102 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.838076    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:51.842252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.842225    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:51.850008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.849986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-web-config" (OuterVolumeSpecName: "web-config") pod "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" (UID: "6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:51.894048 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.893954    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerID="72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b" exitCode=0
Sep 10 14:30:51.894048 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.894001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b"}
Sep 10 14:30:51.894048 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.894039    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:51.894366 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.894105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6","Type":"ContainerDied","Data":"5ce7ebb6be80374ed6618ab744ccc86652cf3e99d667d7c07c7c654d61015818"}
Sep 10 14:30:51.894366 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.894153    2561 scope.go:117] "RemoveContainer" containerID="4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8"
Sep 10 14:30:51.905789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.905767    2561 scope.go:117] "RemoveContainer" containerID="b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62"
Sep 10 14:30:51.913070 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.913045    2561 scope.go:117] "RemoveContainer" containerID="9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab"
Sep 10 14:30:51.920211 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.920120    2561 scope.go:117] "RemoveContainer" containerID="72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b"
Sep 10 14:30:51.923337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.923309    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:30:51.928572 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.928547    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:30:51.929294 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.929270    2561 scope.go:117] "RemoveContainer" containerID="6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830"
Sep 10 14:30:51.934726 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934688    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-main-tls\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934726 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934723    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934734    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-config-out\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934743    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-metrics-client-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934751    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-cluster-tls-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934760    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934769    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxn99\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-kube-api-access-wxn99\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934777    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-tls-assets\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934785    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934793    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934803    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.934883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.934833    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6-web-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:51.936969 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.936956    2561 scope.go:117] "RemoveContainer" containerID="60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe"
Sep 10 14:30:51.944448 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.944423    2561 scope.go:117] "RemoveContainer" containerID="6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f"
Sep 10 14:30:51.952227 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.952204    2561 scope.go:117] "RemoveContainer" containerID="4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8"
Sep 10 14:30:51.952538 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:51.952513    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8\": container with ID starting with 4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8 not found: ID does not exist" containerID="4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8"
Sep 10 14:30:51.952590 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.952550    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8"} err="failed to get container status \"4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8\": rpc error: code = NotFound desc = could not find container \"4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8\": container with ID starting with 4e70f915238671da74b7c0b57d1e1d7bab6c1a8b1748978db943902f28930ed8 not found: ID does not exist"
Sep 10 14:30:51.952590 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.952571    2561 scope.go:117] "RemoveContainer" containerID="b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62"
Sep 10 14:30:51.952924 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:51.952896    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62\": container with ID starting with b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62 not found: ID does not exist" containerID="b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62"
Sep 10 14:30:51.952978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.952921    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62"} err="failed to get container status \"b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62\": rpc error: code = NotFound desc = could not find container \"b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62\": container with ID starting with b813fa7bb57cf08df084b34a2cf1f5ab47f88e13c74eda5bf2b1992e5863dd62 not found: ID does not exist"
Sep 10 14:30:51.952978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.952936    2561 scope.go:117] "RemoveContainer" containerID="9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab"
Sep 10 14:30:51.953205 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:51.953183    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab\": container with ID starting with 9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab not found: ID does not exist" containerID="9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab"
Sep 10 14:30:51.953250 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.953209    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab"} err="failed to get container status \"9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab\": rpc error: code = NotFound desc = could not find container \"9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab\": container with ID starting with 9e72e10884a0c5760c3fd20b46b736670c902a2dcd37deaf3d5964866a07c7ab not found: ID does not exist"
Sep 10 14:30:51.953250 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.953223    2561 scope.go:117] "RemoveContainer" containerID="72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b"
Sep 10 14:30:51.953462 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:51.953447    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b\": container with ID starting with 72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b not found: ID does not exist" containerID="72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b"
Sep 10 14:30:51.953506 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.953467    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b"} err="failed to get container status \"72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b\": rpc error: code = NotFound desc = could not find container \"72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b\": container with ID starting with 72127dd3972711b5a8ae368aaf2ae0543011ac17ca472644ccf7b1c86b34c74b not found: ID does not exist"
Sep 10 14:30:51.953506 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.953481    2561 scope.go:117] "RemoveContainer" containerID="6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830"
Sep 10 14:30:51.953786 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:51.953740    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830\": container with ID starting with 6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830 not found: ID does not exist" containerID="6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830"
Sep 10 14:30:51.953786 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.953767    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830"} err="failed to get container status \"6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830\": rpc error: code = NotFound desc = could not find container \"6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830\": container with ID starting with 6f79a591c4eb4c2c54df045104b677e40610bf471e9ecf65c0edac769be7f830 not found: ID does not exist"
Sep 10 14:30:51.953786 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.953784    2561 scope.go:117] "RemoveContainer" containerID="60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe"
Sep 10 14:30:51.954035 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:51.954020    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe\": container with ID starting with 60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe not found: ID does not exist" containerID="60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe"
Sep 10 14:30:51.954076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.954037    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe"} err="failed to get container status \"60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe\": rpc error: code = NotFound desc = could not find container \"60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe\": container with ID starting with 60a4809f32fdde7a302d714bbf8a98b56ad923ef57112d8895f9a993079d6efe not found: ID does not exist"
Sep 10 14:30:51.954076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.954048    2561 scope.go:117] "RemoveContainer" containerID="6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f"
Sep 10 14:30:51.954312 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:30:51.954286    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f\": container with ID starting with 6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f not found: ID does not exist" containerID="6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f"
Sep 10 14:30:51.954392 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.954309    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f"} err="failed to get container status \"6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f\": rpc error: code = NotFound desc = could not find container \"6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f\": container with ID starting with 6c384e93385294a06e63f6f1fa23e57780d71d2f916c0c6b7a4e638eed7c1c1f not found: ID does not exist"
Sep 10 14:30:51.965504 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965475    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:30:51.965847 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965833    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-web"
Sep 10 14:30:51.965894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965849    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-web"
Sep 10 14:30:51.965894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965859    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="prom-label-proxy"
Sep 10 14:30:51.965894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965866    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="prom-label-proxy"
Sep 10 14:30:51.965894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965888    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" containerName="console"
Sep 10 14:30:51.965894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965894    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" containerName="console"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965902    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" containerName="console"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965907    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" containerName="console"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965914    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="alertmanager"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965919    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="alertmanager"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965927    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965932    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965938    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-metric"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965945    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-metric"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965959    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="config-reloader"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965973    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="config-reloader"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965982    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="init-config-reloader"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965987    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="init-config-reloader"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965994    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c83545-a2f6-4aef-9f9a-14745b3892ac" containerName="console"
Sep 10 14:30:51.966052 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.965999    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c83545-a2f6-4aef-9f9a-14745b3892ac" containerName="console"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966058    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-web"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966067    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c83545-a2f6-4aef-9f9a-14745b3892ac" containerName="console"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966073    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="prom-label-proxy"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966081    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ab12b6-b4b5-41d8-9bca-2e19bc6343a3" containerName="console"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966087    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="71874a96-f6e5-40d5-a2aa-d43b6dcf32ec" containerName="console"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966093    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="config-reloader"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966100    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966109    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="alertmanager"
Sep 10 14:30:51.966438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.966117    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" containerName="kube-rbac-proxy-metric"
Sep 10 14:30:51.970010 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.969990    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:51.974984 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.974961    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 14:30:51.975733 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.975696    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 14:30:51.975833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.975744    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 14:30:51.975833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.975766    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 14:30:51.975833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.975796    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 14:30:51.975833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.975751    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 14:30:51.976047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.975966    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 14:30:51.976208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.976189    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mpwxf\""
Sep 10 14:30:51.976475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.976459    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 14:30:51.982603 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.982581    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 14:30:51.993396 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.993364    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6" path="/var/lib/kubelet/pods/6b5a44fb-86d5-4b95-8aaf-068bbdc2a1d6/volumes"
Sep 10 14:30:51.993973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:51.993952    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:30:52.035781 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.035744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-config-out\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.035781 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.035782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.035979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.035811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.035979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.035852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.035979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.035922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-web-config\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.035979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.035953    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.035979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.035970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.036146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.036012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.036146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.036036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.036146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.036050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.036146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.036077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr7k6\" (UniqueName: \"kubernetes.io/projected/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-kube-api-access-mr7k6\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.036292 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.036144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.036292 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.036180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137391 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr7k6\" (UniqueName: \"kubernetes.io/projected/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-kube-api-access-mr7k6\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137576 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-config-out\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137576 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-web-config\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.137886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.137857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.138750 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.138722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.138964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.138937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.140681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.140532    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-config-out\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.140681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.140565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.140681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.140630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.141963 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.141921    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.142089 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.142060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.142290 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.142265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.142378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.142312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.143040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.143016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-web-config\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.144126 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.144073    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.145660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.145640    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr7k6\" (UniqueName: \"kubernetes.io/projected/48bc3cdb-b0cf-4d68-a695-ea78612e18b2-kube-api-access-mr7k6\") pod \"alertmanager-main-0\" (UID: \"48bc3cdb-b0cf-4d68-a695-ea78612e18b2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.279853 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.279807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:30:52.556885 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.556859    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:30:52.559481 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:30:52.559449    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48bc3cdb_b0cf_4d68_a695_ea78612e18b2.slice/crio-b81eb2a32303af6f88aecc03c775505a11c3991b80f14c374edc8f049da5e82f WatchSource:0}: Error finding container b81eb2a32303af6f88aecc03c775505a11c3991b80f14c374edc8f049da5e82f: Status 404 returned error can't find the container with id b81eb2a32303af6f88aecc03c775505a11c3991b80f14c374edc8f049da5e82f
Sep 10 14:30:52.901524 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.901494    2561 generic.go:356] "Generic (PLEG): container finished" podID="48bc3cdb-b0cf-4d68-a695-ea78612e18b2" containerID="7cc126045724a6d2650a8ea73f00b91f5ebb243559449ad6cf41b2995b3724f5" exitCode=0
Sep 10 14:30:52.901930 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.901536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerDied","Data":"7cc126045724a6d2650a8ea73f00b91f5ebb243559449ad6cf41b2995b3724f5"}
Sep 10 14:30:52.901930 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:52.901585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerStarted","Data":"b81eb2a32303af6f88aecc03c775505a11c3991b80f14c374edc8f049da5e82f"}
Sep 10 14:30:53.910855 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.910817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerStarted","Data":"78e4fed55bac97e917177e215cf13cfada4fb377c2186411d76332f764be2294"}
Sep 10 14:30:53.911260 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.910891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerStarted","Data":"524436a99ed1b6b19d8215724d77924c9cdf084827180279f53cd0aa3bf1efc4"}
Sep 10 14:30:53.911260 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.910918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerStarted","Data":"1646bf655c594bae79318cae067e00f7ebf64fb46441679165ad812ca1972dcf"}
Sep 10 14:30:53.911260 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.910943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerStarted","Data":"720422389a5d243cd89b9ff583790e14e87ac40ef87e08365940d07a1d48e222"}
Sep 10 14:30:53.911260 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.910966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerStarted","Data":"60abd8df1148b553429892542d6b7c8ef0aee9dec8ddf89524b2c3d3125bcaed"}
Sep 10 14:30:53.911260 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.910988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48bc3cdb-b0cf-4d68-a695-ea78612e18b2","Type":"ContainerStarted","Data":"6d6fef0b6f77354950041f3ced5aac67b48a37801c15bfa083a772ffb16ef8f6"}
Sep 10 14:30:53.948378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.948323    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.930747663 podStartE2EDuration="2.948306556s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.558893ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:53.946607592 +0000 UTC m=+168.410974116" watchObservedRunningTime="2026-09-10 14:30:53.948306556 +0000 UTC m=+168.412673078"
Sep 10 14:30:53.982548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.982516    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9d98ddb5-z7p7g"]
Sep 10 14:30:53.984686 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.984670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:53.999605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:53.999578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9d98ddb5-z7p7g"]
Sep 10 14:30:54.056654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.056619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-config\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.056849 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.056760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kbf\" (UniqueName: \"kubernetes.io/projected/cd290d95-50c3-4d02-91c3-93bf2342f7b7-kube-api-access-92kbf\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.056849 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.056819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-oauth-config\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.056964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.056883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-service-ca\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.056964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.056935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-trusted-ca-bundle\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.057074 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.057030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-serving-cert\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.057137 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.057084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-oauth-serving-cert\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.157991 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.157950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-config\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158162 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92kbf\" (UniqueName: \"kubernetes.io/projected/cd290d95-50c3-4d02-91c3-93bf2342f7b7-kube-api-access-92kbf\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158162 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-oauth-config\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158231 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-service-ca\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158231 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-trusted-ca-bundle\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158297 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-serving-cert\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158297 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158275    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-oauth-serving-cert\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158853 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-config\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.158853 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.158838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-service-ca\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.159085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.159062    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-oauth-serving-cert\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.159144 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.159069    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-trusted-ca-bundle\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.160613 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.160589    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-oauth-config\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.160828 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.160811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-serving-cert\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.166893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.166830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kbf\" (UniqueName: \"kubernetes.io/projected/cd290d95-50c3-4d02-91c3-93bf2342f7b7-kube-api-access-92kbf\") pod \"console-f9d98ddb5-z7p7g\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") " pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.296826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.296791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:30:54.579772 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.579683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9d98ddb5-z7p7g"]
Sep 10 14:30:54.583432 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:30:54.583398    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd290d95_50c3_4d02_91c3_93bf2342f7b7.slice/crio-602bd376ca3def331c68598282cf50d8186d884e7a44dd30043828e2120213b1 WatchSource:0}: Error finding container 602bd376ca3def331c68598282cf50d8186d884e7a44dd30043828e2120213b1: Status 404 returned error can't find the container with id 602bd376ca3def331c68598282cf50d8186d884e7a44dd30043828e2120213b1
Sep 10 14:30:54.791538 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.791503    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:30:54.791821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.791795    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="prometheus" containerID="cri-o://7c48507232aeb936aea7b5e4ee3b71337bc025877146fc9f830a042f0168a932" gracePeriod=600
Sep 10 14:30:54.791899 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.791823    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy" containerID="cri-o://21fe5b8c2174f207ab3ffd9478b4e984aabe9d87ebdad0594bd5c3cb3101d974" gracePeriod=600
Sep 10 14:30:54.791899 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.791850    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dc879e59b1b3e808391bd39fabe44ba30a0821357f137fe3c599d4b3558fedd1" gracePeriod=600
Sep 10 14:30:54.792021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.791875    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-web" containerID="cri-o://b76d90bcf57c61675746f5f96f5b80a5fb69c3800421b855ff43c1d39629d6d3" gracePeriod=600
Sep 10 14:30:54.792021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.791889    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="thanos-sidecar" containerID="cri-o://3aa05750dac578884ed825424d7324979be7d29d2df26e1ea752df6458b2fc41" gracePeriod=600
Sep 10 14:30:54.792113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.791910    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="config-reloader" containerID="cri-o://dabeba2f7ea6ee30615643fb5b215e797b6bc73b46c21a1304ddc8bba81e90d6" gracePeriod=600
Sep 10 14:30:54.922027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.921999    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab41057-afe2-4f80-a4de-e22992cec623" containerID="dc879e59b1b3e808391bd39fabe44ba30a0821357f137fe3c599d4b3558fedd1" exitCode=0
Sep 10 14:30:54.922027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922027    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab41057-afe2-4f80-a4de-e22992cec623" containerID="21fe5b8c2174f207ab3ffd9478b4e984aabe9d87ebdad0594bd5c3cb3101d974" exitCode=0
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922040    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab41057-afe2-4f80-a4de-e22992cec623" containerID="b76d90bcf57c61675746f5f96f5b80a5fb69c3800421b855ff43c1d39629d6d3" exitCode=0
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922061    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab41057-afe2-4f80-a4de-e22992cec623" containerID="3aa05750dac578884ed825424d7324979be7d29d2df26e1ea752df6458b2fc41" exitCode=0
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922073    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab41057-afe2-4f80-a4de-e22992cec623" containerID="dabeba2f7ea6ee30615643fb5b215e797b6bc73b46c21a1304ddc8bba81e90d6" exitCode=0
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"dc879e59b1b3e808391bd39fabe44ba30a0821357f137fe3c599d4b3558fedd1"}
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922082    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab41057-afe2-4f80-a4de-e22992cec623" containerID="7c48507232aeb936aea7b5e4ee3b71337bc025877146fc9f830a042f0168a932" exitCode=0
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922168    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"21fe5b8c2174f207ab3ffd9478b4e984aabe9d87ebdad0594bd5c3cb3101d974"}
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"b76d90bcf57c61675746f5f96f5b80a5fb69c3800421b855ff43c1d39629d6d3"}
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922255    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"3aa05750dac578884ed825424d7324979be7d29d2df26e1ea752df6458b2fc41"}
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"dabeba2f7ea6ee30615643fb5b215e797b6bc73b46c21a1304ddc8bba81e90d6"}
Sep 10 14:30:54.922443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.922334    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"7c48507232aeb936aea7b5e4ee3b71337bc025877146fc9f830a042f0168a932"}
Sep 10 14:30:54.924011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.923986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d98ddb5-z7p7g" event={"ID":"cd290d95-50c3-4d02-91c3-93bf2342f7b7","Type":"ContainerStarted","Data":"e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a"}
Sep 10 14:30:54.924107 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.924031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d98ddb5-z7p7g" event={"ID":"cd290d95-50c3-4d02-91c3-93bf2342f7b7","Type":"ContainerStarted","Data":"602bd376ca3def331c68598282cf50d8186d884e7a44dd30043828e2120213b1"}
Sep 10 14:30:54.943374 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:54.943312    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f9d98ddb5-z7p7g" podStartSLOduration=1.943291589 podStartE2EDuration="1.943291589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:54.942833705 +0000 UTC m=+169.407200228" watchObservedRunningTime="2026-09-10 14:30:54.943291589 +0000 UTC m=+169.407658112"
Sep 10 14:30:55.044049 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.044025    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:55.168132 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168093    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-thanos-prometheus-http-client-file\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168132 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168138    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-metrics-client-ca\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168154    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-2\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168179    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-1\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168219    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-serving-certs-ca-bundle\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168248    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-web-config\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168276    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168303    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-trusted-ca-bundle\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-tls\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168380    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-grpc-tls\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-kubelet-serving-ca-bundle\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168449    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-0\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168479    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-db\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168501    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-metrics-client-certs\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168508    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168536    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fvpk\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-kube-api-access-4fvpk\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168567    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168604    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168609    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-kube-rbac-proxy\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-config-out\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.168740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168727    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-config\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.169433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168760    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-tls-assets\") pod \"2ab41057-afe2-4f80-a4de-e22992cec623\" (UID: \"2ab41057-afe2-4f80-a4de-e22992cec623\") "
Sep 10 14:30:55.169433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.168874    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:55.169433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.169194    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.169433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.169213    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.169433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.169227    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-metrics-client-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.169433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.169241    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.169433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.169253    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.169782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.169610    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:30:55.169922 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.169897    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:55.171230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.171193    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.171445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.171414    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.171532 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.171472    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-kube-api-access-4fvpk" (OuterVolumeSpecName: "kube-api-access-4fvpk") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "kube-api-access-4fvpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:55.171601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.171585    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:55.171658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.171601    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:55.172089 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.172051    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.172232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.172115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.173074 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.173048    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.173363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.173343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-config-out" (OuterVolumeSpecName: "config-out") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:30:55.173438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.173399    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-config" (OuterVolumeSpecName: "config") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.173545 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.173522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.173763 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.173738    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.184390 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.184368    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-web-config" (OuterVolumeSpecName: "web-config") pod "2ab41057-afe2-4f80-a4de-e22992cec623" (UID: "2ab41057-afe2-4f80-a4de-e22992cec623"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:30:55.269979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.269942    2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-kube-rbac-proxy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.269979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.269973    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-config-out\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.269979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.269984    2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.269991    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-tls-assets\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270002    2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270012    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-web-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270022    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270031    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270040    2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-grpc-tls\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270048    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270056    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270065    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ab41057-afe2-4f80-a4de-e22992cec623-prometheus-k8s-db\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270073    2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-metrics-client-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270083    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fvpk\" (UniqueName: \"kubernetes.io/projected/2ab41057-afe2-4f80-a4de-e22992cec623-kube-api-access-4fvpk\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.270210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.270091    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ab41057-afe2-4f80-a4de-e22992cec623-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:30:55.937226 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.937191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ab41057-afe2-4f80-a4de-e22992cec623","Type":"ContainerDied","Data":"a5bcc372762bf303fab6672ee533419dd572241c49e6356072637ebf3415d8e6"}
Sep 10 14:30:55.937731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.937228    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:55.937731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.937299    2561 scope.go:117] "RemoveContainer" containerID="dc879e59b1b3e808391bd39fabe44ba30a0821357f137fe3c599d4b3558fedd1"
Sep 10 14:30:55.946576 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.946358    2561 scope.go:117] "RemoveContainer" containerID="21fe5b8c2174f207ab3ffd9478b4e984aabe9d87ebdad0594bd5c3cb3101d974"
Sep 10 14:30:55.953560 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.953542    2561 scope.go:117] "RemoveContainer" containerID="b76d90bcf57c61675746f5f96f5b80a5fb69c3800421b855ff43c1d39629d6d3"
Sep 10 14:30:55.960835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.960754    2561 scope.go:117] "RemoveContainer" containerID="3aa05750dac578884ed825424d7324979be7d29d2df26e1ea752df6458b2fc41"
Sep 10 14:30:55.962390 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.962368    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:30:55.967048 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.967022    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:30:55.968475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.968458    2561 scope.go:117] "RemoveContainer" containerID="dabeba2f7ea6ee30615643fb5b215e797b6bc73b46c21a1304ddc8bba81e90d6"
Sep 10 14:30:55.976424 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.976411    2561 scope.go:117] "RemoveContainer" containerID="7c48507232aeb936aea7b5e4ee3b71337bc025877146fc9f830a042f0168a932"
Sep 10 14:30:55.984811 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.984781    2561 scope.go:117] "RemoveContainer" containerID="ad4cc20fe68750eb1c182331f66c35a38cf61cdcf4b02a594b30094f34be8958"
Sep 10 14:30:55.994097 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994075    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" path="/var/lib/kubelet/pods/2ab41057-afe2-4f80-a4de-e22992cec623/volumes"
Sep 10 14:30:55.994566 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994552    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:30:55.994937 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994921    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="prometheus"
Sep 10 14:30:55.994978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994941    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="prometheus"
Sep 10 14:30:55.994978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994957    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-thanos"
Sep 10 14:30:55.994978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994966    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-thanos"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994978    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-web"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.994987    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-web"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995001    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="init-config-reloader"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995009    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="init-config-reloader"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995031    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="config-reloader"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995037    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="config-reloader"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995045    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995051    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995059    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="thanos-sidecar"
Sep 10 14:30:55.995078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995064    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="thanos-sidecar"
Sep 10 14:30:55.995436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995128    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="config-reloader"
Sep 10 14:30:55.995436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995136    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="thanos-sidecar"
Sep 10 14:30:55.995436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995143    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-web"
Sep 10 14:30:55.995436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995148    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy"
Sep 10 14:30:55.995436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995152    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="kube-rbac-proxy-thanos"
Sep 10 14:30:55.995436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.995159    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab41057-afe2-4f80-a4de-e22992cec623" containerName="prometheus"
Sep 10 14:30:55.998192 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:55.998175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.000753 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.000732    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 14:30:56.000865 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.000845    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 14:30:56.001087 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001072    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 14:30:56.001155 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001089    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 14:30:56.001212 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001168    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 14:30:56.001303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001285    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 14:30:56.001367 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001285    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6r2okg9iugck7\""
Sep 10 14:30:56.001509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001493    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 14:30:56.001563 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001520    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 14:30:56.001614 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001599    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 14:30:56.001668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001613    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jcm9t\""
Sep 10 14:30:56.001668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001600    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 14:30:56.001790 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.001755    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 14:30:56.002412 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.002393    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 14:30:56.005145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.005051    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 14:30:56.007294 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.007273    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 14:30:56.014086 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.014065    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:30:56.076797 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.076758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.076806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.076856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.076902    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.076930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.076956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-config\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.076984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m24nf\" (UniqueName: \"kubernetes.io/projected/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-kube-api-access-m24nf\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.077814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.077582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.178683 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.178648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.178860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.178691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.178860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.178733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.178860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.178752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-config\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.178860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.178770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.178860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.178786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.178860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.178806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179076    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m24nf\" (UniqueName: \"kubernetes.io/projected/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-kube-api-access-m24nf\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.179886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.180008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.179946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.182368 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.182296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-config\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.182368 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.182358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.182552 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.182402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.182552 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.182428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.182552 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.182483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.183313 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.182981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.183313 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.183174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.183313 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.183244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.183541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.183356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.183772 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.183754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.183976 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.183956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.184897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.184877    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.184972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.184932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.185318 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.185300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.185470 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.185453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.188779 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.188731    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m24nf\" (UniqueName: \"kubernetes.io/projected/ee2fd6fd-2270-4c35-8da3-2e590ddf4a32-kube-api-access-m24nf\") pod \"prometheus-k8s-0\" (UID: \"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.308145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.308109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:30:56.590831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.590805    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:30:56.593152 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:30:56.593126    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2fd6fd_2270_4c35_8da3_2e590ddf4a32.slice/crio-fcfbdeaf0f9bf266fa9cce96a39c5f008d12f7cad87a8885b9d4473c68938fb3 WatchSource:0}: Error finding container fcfbdeaf0f9bf266fa9cce96a39c5f008d12f7cad87a8885b9d4473c68938fb3: Status 404 returned error can't find the container with id fcfbdeaf0f9bf266fa9cce96a39c5f008d12f7cad87a8885b9d4473c68938fb3
Sep 10 14:30:56.944619 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.944585    2561 generic.go:356] "Generic (PLEG): container finished" podID="ee2fd6fd-2270-4c35-8da3-2e590ddf4a32" containerID="f84855d242daae885b1ea709a31cc301fefc2db4fcf62cdf1cd0dd4c699af5b7" exitCode=0
Sep 10 14:30:56.945012 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.944624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerDied","Data":"f84855d242daae885b1ea709a31cc301fefc2db4fcf62cdf1cd0dd4c699af5b7"}
Sep 10 14:30:56.945012 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:56.944672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerStarted","Data":"fcfbdeaf0f9bf266fa9cce96a39c5f008d12f7cad87a8885b9d4473c68938fb3"}
Sep 10 14:30:57.955523 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:57.955488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerStarted","Data":"0d459276f7f6ae05bc80c91b47418be6966f3a7d2c662decb00295bf51c65deb"}
Sep 10 14:30:57.955924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:57.955582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerStarted","Data":"bb29291199eed6e481f4163d805cb30d9fcd518325927b378d22b60b65eb1a18"}
Sep 10 14:30:57.955924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:57.955611    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerStarted","Data":"a02e1dbb06352fd954f46abbc3441433793bfbb4c1d6e5a35ee99748c68eea9f"}
Sep 10 14:30:57.955924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:57.955640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerStarted","Data":"fd9db847d68a2bd53375bf9eb4e96f40f72239a348c0b28cedc042ef2e6f003f"}
Sep 10 14:30:57.955924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:57.955665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerStarted","Data":"8bf7ff95617c8ef062dc1ce5edafffdb388fe1961ae02bae20160bfee0042c12"}
Sep 10 14:30:57.955924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:57.955695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee2fd6fd-2270-4c35-8da3-2e590ddf4a32","Type":"ContainerStarted","Data":"9e51ce72d247d0cc9706ab62fd609e5afba7cdfe22e0683229eb196f0182246c"}
Sep 10 14:30:57.985741 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:30:57.985657    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.965317147 podStartE2EDuration="2.985636004s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.318857ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:57.985009633 +0000 UTC m=+172.449376167" watchObservedRunningTime="2026-09-10 14:30:57.985636004 +0000 UTC m=+172.450002527"
Sep 10 14:31:01.309300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:01.309256    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:31:04.297493 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:04.297435    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:31:04.297895 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:04.297512    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:31:04.302427 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:04.302402    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:31:04.999289 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:04.999255    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:31:05.048082 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:05.048044    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4b56554-w7r64"]
Sep 10 14:31:30.070451 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.070398    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d4b56554-w7r64" podUID="1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" containerName="console" containerID="cri-o://bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474" gracePeriod=15
Sep 10 14:31:30.331353 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.331288    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:31:30.423433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423397    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqc7r\" (UniqueName: \"kubernetes.io/projected/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-kube-api-access-tqc7r\") pod \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") "
Sep 10 14:31:30.423613 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423466    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-trusted-ca-bundle\") pod \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") "
Sep 10 14:31:30.423613 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423588    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-service-ca\") pod \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") "
Sep 10 14:31:30.423722 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-oauth-config\") pod \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") "
Sep 10 14:31:30.423722 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423656    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-config\") pod \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") "
Sep 10 14:31:30.423868 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423831    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-serving-cert\") pod \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") "
Sep 10 14:31:30.423959 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423937    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-oauth-serving-cert\") pod \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\" (UID: \"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c\") "
Sep 10 14:31:30.424029 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423973    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" (UID: "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:30.424029 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.423992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-config" (OuterVolumeSpecName: "console-config") pod "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" (UID: "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:30.424029 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.424014    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-service-ca" (OuterVolumeSpecName: "service-ca") pod "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" (UID: "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:30.424251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.424230    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:31:30.424320 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.424254    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:31:30.424320 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.424269    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:31:30.424415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.424392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" (UID: "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:30.425882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.425856    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" (UID: "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:31:30.425882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.425875    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" (UID: "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:31:30.426044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.425861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-kube-api-access-tqc7r" (OuterVolumeSpecName: "kube-api-access-tqc7r") pod "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" (UID: "1fe0b337-bdd5-4f65-a8f1-aa72fba1904c"). InnerVolumeSpecName "kube-api-access-tqc7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:30.525731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.525661    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:31:30.525731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.525695    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:31:30.525731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.525737    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:31:30.526029 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:30.525749    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqc7r\" (UniqueName: \"kubernetes.io/projected/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c-kube-api-access-tqc7r\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:31:31.103521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.103486    2561 generic.go:356] "Generic (PLEG): container finished" podID="1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" containerID="bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474" exitCode=0
Sep 10 14:31:31.103983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.103528    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4b56554-w7r64"
Sep 10 14:31:31.103983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.103541    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b56554-w7r64" event={"ID":"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c","Type":"ContainerDied","Data":"bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474"}
Sep 10 14:31:31.103983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.103586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4b56554-w7r64" event={"ID":"1fe0b337-bdd5-4f65-a8f1-aa72fba1904c","Type":"ContainerDied","Data":"b5d3bf1bea0da0b11b228c34fcf2acf6623636900ab3ce5779381be56a1fa370"}
Sep 10 14:31:31.103983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.103606    2561 scope.go:117] "RemoveContainer" containerID="bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474"
Sep 10 14:31:31.112587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.112569    2561 scope.go:117] "RemoveContainer" containerID="bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474"
Sep 10 14:31:31.112933 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:31:31.112913    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474\": container with ID starting with bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474 not found: ID does not exist" containerID="bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474"
Sep 10 14:31:31.112993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.112943    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474"} err="failed to get container status \"bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474\": rpc error: code = NotFound desc = could not find container \"bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474\": container with ID starting with bf721bfa9981ab0e746dff4f0aea985d3251f2bd0ba80a242c0573a0136bf474 not found: ID does not exist"
Sep 10 14:31:31.127894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.127862    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4b56554-w7r64"]
Sep 10 14:31:31.131891 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.131863    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d4b56554-w7r64"]
Sep 10 14:31:31.993485 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:31.993449    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" path="/var/lib/kubelet/pods/1fe0b337-bdd5-4f65-a8f1-aa72fba1904c/volumes"
Sep 10 14:31:56.309132 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:56.309077    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:31:56.324819 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:56.324792    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:31:57.233548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:31:57.233513    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:32:55.908638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.908601    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"]
Sep 10 14:32:55.909179 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.909156    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" containerName="console"
Sep 10 14:32:55.909224 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.909185    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" containerName="console"
Sep 10 14:32:55.909300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.909287    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe0b337-bdd5-4f65-a8f1-aa72fba1904c" containerName="console"
Sep 10 14:32:55.912567 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.912540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:55.915642 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.915617    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 14:32:55.915859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.915694    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 14:32:55.916131 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.916108    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 14:32:55.916250 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.916151    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2nvw6\""
Sep 10 14:32:55.916250 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.916158    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 14:32:55.931002 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.930967    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"]
Sep 10 14:32:55.976416 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.976380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjcg6\" (UniqueName: \"kubernetes.io/projected/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-kube-api-access-bjcg6\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:55.976660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.976431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-tmp\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:55.976660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.976534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-manifests\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:55.976660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.976577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:55.976660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:55.976599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.077757 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.077685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcg6\" (UniqueName: \"kubernetes.io/projected/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-kube-api-access-bjcg6\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.077957 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.077773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-tmp\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.077957 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.077871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-manifests\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.077957 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.077914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.077957 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.077941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.078308 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.078283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-manifests\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.080197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.080170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-tmp\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.080520 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.080500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.080564 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.080500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.085951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.085920    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjcg6\" (UniqueName: \"kubernetes.io/projected/3cfb4c6b-b4f8-4349-9e29-2ec00451bca7-kube-api-access-bjcg6\") pod \"opendatahub-operator-controller-manager-77dd699645-f425c\" (UID: \"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7\") " pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.223063 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.222954    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:32:56.506434 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:56.506348    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"]
Sep 10 14:32:56.510086 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:32:56.510049    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfb4c6b_b4f8_4349_9e29_2ec00451bca7.slice/crio-1d63dddc2af2d812e6439689c9ba1e620a58156a5f2189bf0e31f25fee2acd25 WatchSource:0}: Error finding container 1d63dddc2af2d812e6439689c9ba1e620a58156a5f2189bf0e31f25fee2acd25: Status 404 returned error can't find the container with id 1d63dddc2af2d812e6439689c9ba1e620a58156a5f2189bf0e31f25fee2acd25
Sep 10 14:32:57.476152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:32:57.476109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c" event={"ID":"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7","Type":"ContainerStarted","Data":"1d63dddc2af2d812e6439689c9ba1e620a58156a5f2189bf0e31f25fee2acd25"}
Sep 10 14:33:00.493298 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:00.493259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c" event={"ID":"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7","Type":"ContainerStarted","Data":"db50422cd8c813358210b6492bc20ff1cfedc850f5fbd64c5b4cb94957a0544c"}
Sep 10 14:33:01.500078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:01.500043    2561 generic.go:356] "Generic (PLEG): container finished" podID="3cfb4c6b-b4f8-4349-9e29-2ec00451bca7" containerID="db50422cd8c813358210b6492bc20ff1cfedc850f5fbd64c5b4cb94957a0544c" exitCode=0
Sep 10 14:33:01.500571 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:01.500095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c" event={"ID":"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7","Type":"ContainerDied","Data":"db50422cd8c813358210b6492bc20ff1cfedc850f5fbd64c5b4cb94957a0544c"}
Sep 10 14:33:02.506988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:02.506897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c" event={"ID":"3cfb4c6b-b4f8-4349-9e29-2ec00451bca7","Type":"ContainerStarted","Data":"101b3a9bb05f83f0d04aa09c6e8d9809af8df34f18e6dc8fdc0bac019e594c56"}
Sep 10 14:33:02.506988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:02.506960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:33:02.529540 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:02.529484    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c" podStartSLOduration=2.926151224 podStartE2EDuration="7.52946659s" totalImagesPullingTime="3.570662619s" totalInitContainerRuntime="1.032652747s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:02.526979441 +0000 UTC m=+296.991345974" watchObservedRunningTime="2026-09-10 14:33:02.52946659 +0000 UTC m=+296.993833111"
Sep 10 14:33:05.916340 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:05.916313    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 14:33:13.515040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:13.515006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77dd699645-f425c"
Sep 10 14:33:24.030659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.030624    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"]
Sep 10 14:33:24.032956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.032933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.036575 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.036551    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 14:33:24.037668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.037653    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 14:33:24.039350 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.039325    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 14:33:24.039491 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.039423    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tg6fs\""
Sep 10 14:33:24.047127 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.047090    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"]
Sep 10 14:33:24.141269 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be798e1b-8355-46f8-b39c-e84090351bdf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfj2z\" (UniqueName: \"kubernetes.io/projected/be798e1b-8355-46f8-b39c-e84090351bdf-kube-api-access-gfj2z\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be798e1b-8355-46f8-b39c-e84090351bdf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be798e1b-8355-46f8-b39c-e84090351bdf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.141609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.141545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242278 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242278 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be798e1b-8355-46f8-b39c-e84090351bdf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be798e1b-8355-46f8-b39c-e84090351bdf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242388    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be798e1b-8355-46f8-b39c-e84090351bdf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242845 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfj2z\" (UniqueName: \"kubernetes.io/projected/be798e1b-8355-46f8-b39c-e84090351bdf-kube-api-access-gfj2z\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242845 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242695    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242952 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242890    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.242990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.242950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.243151 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.243128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be798e1b-8355-46f8-b39c-e84090351bdf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.243275 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.243127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.244684 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.244665    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be798e1b-8355-46f8-b39c-e84090351bdf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.245045 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.245025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be798e1b-8355-46f8-b39c-e84090351bdf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.255308 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.255279    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be798e1b-8355-46f8-b39c-e84090351bdf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.256309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.256288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfj2z\" (UniqueName: \"kubernetes.io/projected/be798e1b-8355-46f8-b39c-e84090351bdf-kube-api-access-gfj2z\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7\" (UID: \"be798e1b-8355-46f8-b39c-e84090351bdf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.343521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.343419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:24.630601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.630522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"]
Sep 10 14:33:24.634015 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:33:24.633982    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe798e1b_8355_46f8_b39c_e84090351bdf.slice/crio-6d1e04d42dcfde8b9c0bac2002443604f05e62109cbf424682f202b6c6732f9c WatchSource:0}: Error finding container 6d1e04d42dcfde8b9c0bac2002443604f05e62109cbf424682f202b6c6732f9c: Status 404 returned error can't find the container with id 6d1e04d42dcfde8b9c0bac2002443604f05e62109cbf424682f202b6c6732f9c
Sep 10 14:33:24.635990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:24.635972    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:33:25.614003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:25.613929    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7" event={"ID":"be798e1b-8355-46f8-b39c-e84090351bdf","Type":"ContainerStarted","Data":"6d1e04d42dcfde8b9c0bac2002443604f05e62109cbf424682f202b6c6732f9c"}
Sep 10 14:33:26.389585 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.389548    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m7492"]
Sep 10 14:33:26.393032 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.393014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:26.395959 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.395930    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 14:33:26.396106 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.396005    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ng62l\""
Sep 10 14:33:26.402349 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.402319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m7492"]
Sep 10 14:33:26.567369 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.567323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x4zk\" (UniqueName: \"kubernetes.io/projected/91d2b052-edce-4aa1-a92a-b587de28f400-kube-api-access-8x4zk\") pod \"odh-model-controller-7998c67dc4-m7492\" (UID: \"91d2b052-edce-4aa1-a92a-b587de28f400\") " pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:26.567551 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.567392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d2b052-edce-4aa1-a92a-b587de28f400-cert\") pod \"odh-model-controller-7998c67dc4-m7492\" (UID: \"91d2b052-edce-4aa1-a92a-b587de28f400\") " pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:26.668402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.668355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x4zk\" (UniqueName: \"kubernetes.io/projected/91d2b052-edce-4aa1-a92a-b587de28f400-kube-api-access-8x4zk\") pod \"odh-model-controller-7998c67dc4-m7492\" (UID: \"91d2b052-edce-4aa1-a92a-b587de28f400\") " pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:26.668943 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.668427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d2b052-edce-4aa1-a92a-b587de28f400-cert\") pod \"odh-model-controller-7998c67dc4-m7492\" (UID: \"91d2b052-edce-4aa1-a92a-b587de28f400\") " pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:26.668943 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:33:26.668591    2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 14:33:26.668943 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:33:26.668674    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91d2b052-edce-4aa1-a92a-b587de28f400-cert podName:91d2b052-edce-4aa1-a92a-b587de28f400 nodeName:}" failed. No retries permitted until 2026-09-10 14:33:27.168652906 +0000 UTC m=+321.633019406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91d2b052-edce-4aa1-a92a-b587de28f400-cert") pod "odh-model-controller-7998c67dc4-m7492" (UID: "91d2b052-edce-4aa1-a92a-b587de28f400") : secret "odh-model-controller-webhook-cert" not found
Sep 10 14:33:26.678099 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.678068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x4zk\" (UniqueName: \"kubernetes.io/projected/91d2b052-edce-4aa1-a92a-b587de28f400-kube-api-access-8x4zk\") pod \"odh-model-controller-7998c67dc4-m7492\" (UID: \"91d2b052-edce-4aa1-a92a-b587de28f400\") " pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:26.912000 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.911966    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q7m4v"]
Sep 10 14:33:26.919265 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.919187    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:26.921905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.921870    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 14:33:26.927600 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:26.927530    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q7m4v"]
Sep 10 14:33:27.072296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.072257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2286f2fb-ed55-42ca-b8e0-a4023f2c031c-tls-certs\") pod \"model-serving-api-54d89bd5fc-q7m4v\" (UID: \"2286f2fb-ed55-42ca-b8e0-a4023f2c031c\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:27.072489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.072439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcmjh\" (UniqueName: \"kubernetes.io/projected/2286f2fb-ed55-42ca-b8e0-a4023f2c031c-kube-api-access-tcmjh\") pod \"model-serving-api-54d89bd5fc-q7m4v\" (UID: \"2286f2fb-ed55-42ca-b8e0-a4023f2c031c\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:27.173510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.173419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2286f2fb-ed55-42ca-b8e0-a4023f2c031c-tls-certs\") pod \"model-serving-api-54d89bd5fc-q7m4v\" (UID: \"2286f2fb-ed55-42ca-b8e0-a4023f2c031c\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:27.173510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.173466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d2b052-edce-4aa1-a92a-b587de28f400-cert\") pod \"odh-model-controller-7998c67dc4-m7492\" (UID: \"91d2b052-edce-4aa1-a92a-b587de28f400\") " pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:27.173755 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.173542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcmjh\" (UniqueName: \"kubernetes.io/projected/2286f2fb-ed55-42ca-b8e0-a4023f2c031c-kube-api-access-tcmjh\") pod \"model-serving-api-54d89bd5fc-q7m4v\" (UID: \"2286f2fb-ed55-42ca-b8e0-a4023f2c031c\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:27.176540 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.176507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d2b052-edce-4aa1-a92a-b587de28f400-cert\") pod \"odh-model-controller-7998c67dc4-m7492\" (UID: \"91d2b052-edce-4aa1-a92a-b587de28f400\") " pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:27.176698 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.176508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2286f2fb-ed55-42ca-b8e0-a4023f2c031c-tls-certs\") pod \"model-serving-api-54d89bd5fc-q7m4v\" (UID: \"2286f2fb-ed55-42ca-b8e0-a4023f2c031c\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:27.187668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.187628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcmjh\" (UniqueName: \"kubernetes.io/projected/2286f2fb-ed55-42ca-b8e0-a4023f2c031c-kube-api-access-tcmjh\") pod \"model-serving-api-54d89bd5fc-q7m4v\" (UID: \"2286f2fb-ed55-42ca-b8e0-a4023f2c031c\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:27.233920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.233878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:27.306185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.306147    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:27.459247 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.459206    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:33:27.459361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.459287    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:33:27.459361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.459319    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:33:27.625668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.625623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7" event={"ID":"be798e1b-8355-46f8-b39c-e84090351bdf","Type":"ContainerStarted","Data":"535975a100fd8d54cb761b3476d243a4c6425ded3753edc60a4d88f86d52db33"}
Sep 10 14:33:27.647040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.646943    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7" podStartSLOduration=0.824120719 podStartE2EDuration="3.646923366s" totalImagesPullingTime="2.822802647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:27.645933107 +0000 UTC m=+322.110299629" watchObservedRunningTime="2026-09-10 14:33:27.646923366 +0000 UTC m=+322.111289888"
Sep 10 14:33:27.661295 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.661258    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q7m4v"]
Sep 10 14:33:27.663625 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:33:27.663595    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2286f2fb_ed55_42ca_b8e0_a4023f2c031c.slice/crio-f4c3214465d09b9afaaa90b1e01e8963ffcaf800bce4e7b1e9660c8b5e6a487b WatchSource:0}: Error finding container f4c3214465d09b9afaaa90b1e01e8963ffcaf800bce4e7b1e9660c8b5e6a487b: Status 404 returned error can't find the container with id f4c3214465d09b9afaaa90b1e01e8963ffcaf800bce4e7b1e9660c8b5e6a487b
Sep 10 14:33:27.663866 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:27.663841    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m7492"]
Sep 10 14:33:27.664478 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:33:27.664430    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d2b052_edce_4aa1_a92a_b587de28f400.slice/crio-0e15c826c024df3411d599a5cda3112133c189d39ef17e5891ceca45680efee5 WatchSource:0}: Error finding container 0e15c826c024df3411d599a5cda3112133c189d39ef17e5891ceca45680efee5: Status 404 returned error can't find the container with id 0e15c826c024df3411d599a5cda3112133c189d39ef17e5891ceca45680efee5
Sep 10 14:33:28.344139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:28.344042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:28.350688 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:28.350431    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:28.636967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:28.636734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m7492" event={"ID":"91d2b052-edce-4aa1-a92a-b587de28f400","Type":"ContainerStarted","Data":"0e15c826c024df3411d599a5cda3112133c189d39ef17e5891ceca45680efee5"}
Sep 10 14:33:28.640936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:28.640884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v" event={"ID":"2286f2fb-ed55-42ca-b8e0-a4023f2c031c","Type":"ContainerStarted","Data":"f4c3214465d09b9afaaa90b1e01e8963ffcaf800bce4e7b1e9660c8b5e6a487b"}
Sep 10 14:33:28.641188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:28.641116    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:28.642219 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:28.642196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7"
Sep 10 14:33:31.657687 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:31.657649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v" event={"ID":"2286f2fb-ed55-42ca-b8e0-a4023f2c031c","Type":"ContainerStarted","Data":"3efa78e74e35e262143ebbb01c86401972cf83405697227114f5ec1e7335326c"}
Sep 10 14:33:31.658186 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:31.657776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:31.659512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:31.659487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m7492" event={"ID":"91d2b052-edce-4aa1-a92a-b587de28f400","Type":"ContainerStarted","Data":"75026b04e041691872942718ea39cfb0008f289e35cbf3f4652d5fba4d255758"}
Sep 10 14:33:31.659626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:31.659613    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:31.673961 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:31.673907    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v" podStartSLOduration=1.859540706 podStartE2EDuration="5.673892286s" totalImagesPullingTime="3.81435158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:31.67288982 +0000 UTC m=+326.137256378" watchObservedRunningTime="2026-09-10 14:33:31.673892286 +0000 UTC m=+326.138258808"
Sep 10 14:33:31.692577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:31.692521    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-m7492" podStartSLOduration=1.831617911 podStartE2EDuration="5.692504422s" totalImagesPullingTime="3.860886511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:31.69153044 +0000 UTC m=+326.155896964" watchObservedRunningTime="2026-09-10 14:33:31.692504422 +0000 UTC m=+326.156870943"
Sep 10 14:33:35.426639 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.426602    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"]
Sep 10 14:33:35.430516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.430489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.433853 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.433820    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 14:33:35.433993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.433824    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 14:33:35.435177 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.435154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 14:33:35.435356 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.435202    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:33:35.435356 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.435243    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wn9lt\""
Sep 10 14:33:35.435356 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.435267    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 14:33:35.444329 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.444303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"]
Sep 10 14:33:35.451641 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.451614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5654ef-b33d-4cb5-9045-c016ce20ddd8-cert\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.451836 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.451667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7dqg\" (UniqueName: \"kubernetes.io/projected/db5654ef-b33d-4cb5-9045-c016ce20ddd8-kube-api-access-f7dqg\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.451836 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.451797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db5654ef-b33d-4cb5-9045-c016ce20ddd8-metrics-cert\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.451926 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.451883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db5654ef-b33d-4cb5-9045-c016ce20ddd8-manager-config\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.553152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.553104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7dqg\" (UniqueName: \"kubernetes.io/projected/db5654ef-b33d-4cb5-9045-c016ce20ddd8-kube-api-access-f7dqg\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.553333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.553165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db5654ef-b33d-4cb5-9045-c016ce20ddd8-metrics-cert\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.553333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.553235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db5654ef-b33d-4cb5-9045-c016ce20ddd8-manager-config\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.553333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.553296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5654ef-b33d-4cb5-9045-c016ce20ddd8-cert\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.554149 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.554116    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db5654ef-b33d-4cb5-9045-c016ce20ddd8-manager-config\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.555795 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.555762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db5654ef-b33d-4cb5-9045-c016ce20ddd8-cert\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.555935 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.555891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db5654ef-b33d-4cb5-9045-c016ce20ddd8-metrics-cert\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.574076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.574044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7dqg\" (UniqueName: \"kubernetes.io/projected/db5654ef-b33d-4cb5-9045-c016ce20ddd8-kube-api-access-f7dqg\") pod \"lws-controller-manager-7c4b8b8b58-pmspv\" (UID: \"db5654ef-b33d-4cb5-9045-c016ce20ddd8\") " pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.741809 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.741727    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:35.892713 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.892679    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"]
Sep 10 14:33:35.896723 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.896684    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:35.899869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.899843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 14:33:35.899990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.899858    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mscwg\""
Sep 10 14:33:35.913362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.913336    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"]
Sep 10 14:33:35.956905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.956873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caffac9b-cab7-4939-9cc5-574d6de34ca4-cert\") pod \"kserve-controller-manager-d6f4b65b8-2vbkl\" (UID: \"caffac9b-cab7-4939-9cc5-574d6de34ca4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:35.957079 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:35.957033    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnnvs\" (UniqueName: \"kubernetes.io/projected/caffac9b-cab7-4939-9cc5-574d6de34ca4-kube-api-access-fnnvs\") pod \"kserve-controller-manager-d6f4b65b8-2vbkl\" (UID: \"caffac9b-cab7-4939-9cc5-574d6de34ca4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:36.034202 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.034163    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"]
Sep 10 14:33:36.036311 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:33:36.036283    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5654ef_b33d_4cb5_9045_c016ce20ddd8.slice/crio-d7b274a17e41ae8102ab05f755215fc50efc8ccd235f922f000d8556b59afc66 WatchSource:0}: Error finding container d7b274a17e41ae8102ab05f755215fc50efc8ccd235f922f000d8556b59afc66: Status 404 returned error can't find the container with id d7b274a17e41ae8102ab05f755215fc50efc8ccd235f922f000d8556b59afc66
Sep 10 14:33:36.057972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.057931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnvs\" (UniqueName: \"kubernetes.io/projected/caffac9b-cab7-4939-9cc5-574d6de34ca4-kube-api-access-fnnvs\") pod \"kserve-controller-manager-d6f4b65b8-2vbkl\" (UID: \"caffac9b-cab7-4939-9cc5-574d6de34ca4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:36.058129 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.058098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caffac9b-cab7-4939-9cc5-574d6de34ca4-cert\") pod \"kserve-controller-manager-d6f4b65b8-2vbkl\" (UID: \"caffac9b-cab7-4939-9cc5-574d6de34ca4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:36.060659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.060637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caffac9b-cab7-4939-9cc5-574d6de34ca4-cert\") pod \"kserve-controller-manager-d6f4b65b8-2vbkl\" (UID: \"caffac9b-cab7-4939-9cc5-574d6de34ca4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:36.072174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.072145    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnnvs\" (UniqueName: \"kubernetes.io/projected/caffac9b-cab7-4939-9cc5-574d6de34ca4-kube-api-access-fnnvs\") pod \"kserve-controller-manager-d6f4b65b8-2vbkl\" (UID: \"caffac9b-cab7-4939-9cc5-574d6de34ca4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:36.207993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.207958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:36.479427 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.479402    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"]
Sep 10 14:33:36.481041 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:33:36.481012    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaffac9b_cab7_4939_9cc5_574d6de34ca4.slice/crio-0891a8353e9e4e423211e2c495fdfc3deff80e11b148a2e454742f7418445e36 WatchSource:0}: Error finding container 0891a8353e9e4e423211e2c495fdfc3deff80e11b148a2e454742f7418445e36: Status 404 returned error can't find the container with id 0891a8353e9e4e423211e2c495fdfc3deff80e11b148a2e454742f7418445e36
Sep 10 14:33:36.691809 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.691728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl" event={"ID":"caffac9b-cab7-4939-9cc5-574d6de34ca4","Type":"ContainerStarted","Data":"0891a8353e9e4e423211e2c495fdfc3deff80e11b148a2e454742f7418445e36"}
Sep 10 14:33:36.693322 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:36.693282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv" event={"ID":"db5654ef-b33d-4cb5-9045-c016ce20ddd8","Type":"ContainerStarted","Data":"d7b274a17e41ae8102ab05f755215fc50efc8ccd235f922f000d8556b59afc66"}
Sep 10 14:33:38.709976 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:38.709932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv" event={"ID":"db5654ef-b33d-4cb5-9045-c016ce20ddd8","Type":"ContainerStarted","Data":"a6e7f366cf00a6f2c39bf12ba6e3ee37e7b5b42cf9323fd0b7669f59bbd71c52"}
Sep 10 14:33:38.710562 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:38.710015    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:33:38.731404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:38.731351    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv" podStartSLOduration=1.431089004 podStartE2EDuration="3.73132049s" totalImagesPullingTime="2.300231486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:38.730814108 +0000 UTC m=+333.195180632" watchObservedRunningTime="2026-09-10 14:33:38.73132049 +0000 UTC m=+333.195687013"
Sep 10 14:33:40.728164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:40.728122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl" event={"ID":"caffac9b-cab7-4939-9cc5-574d6de34ca4","Type":"ContainerStarted","Data":"0607e36145db539181262e5b1620b25d7f2f31b1cebb461d4a152f0cb580863e"}
Sep 10 14:33:40.728562 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:40.728301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:33:40.747011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:40.746949    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl" podStartSLOduration=2.219228598 podStartE2EDuration="5.746931268s" totalImagesPullingTime="3.52770267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:40.745653429 +0000 UTC m=+335.210019950" watchObservedRunningTime="2026-09-10 14:33:40.746931268 +0000 UTC m=+335.211297790"
Sep 10 14:33:42.667019 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:42.666982    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-m7492"
Sep 10 14:33:42.670037 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:42.669998    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-q7m4v"
Sep 10 14:33:49.718062 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:33:49.718033    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c4b8b8b58-pmspv"
Sep 10 14:34:11.738784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:11.738695    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2vbkl"
Sep 10 14:34:13.023439 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.023402    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-857558d647-qrhbn"]
Sep 10 14:34:13.035931 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.035901    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.037768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.037740    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857558d647-qrhbn"]
Sep 10 14:34:13.125496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.125449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75gt\" (UniqueName: \"kubernetes.io/projected/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-kube-api-access-c75gt\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.125694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.125555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-oauth-config\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.125694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.125600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-config\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.125694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.125622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-service-ca\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.125694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.125656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-oauth-serving-cert\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.125876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.125769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-trusted-ca-bundle\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.125876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.125814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-serving-cert\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.227204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.227167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75gt\" (UniqueName: \"kubernetes.io/projected/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-kube-api-access-c75gt\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.227408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.227230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-oauth-config\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.227408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.227273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-config\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.227408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.227290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-service-ca\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.227408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.227313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-oauth-serving-cert\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.227408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.227328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-trusted-ca-bundle\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.227408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.227361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-serving-cert\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.228236 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.228200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-oauth-serving-cert\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.228348 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.228237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-config\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.228348 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.228209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-service-ca\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.228348 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.228266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-trusted-ca-bundle\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.229831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.229805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-serving-cert\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.229958 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.229937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-console-oauth-config\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.234671 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.234651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75gt\" (UniqueName: \"kubernetes.io/projected/ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c-kube-api-access-c75gt\") pod \"console-857558d647-qrhbn\" (UID: \"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c\") " pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.346451 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.346355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:13.618729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.618689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857558d647-qrhbn"]
Sep 10 14:34:13.620782 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:34:13.620754    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd0f9dd_0a5f_42eb_924d_2a80a9ed1c9c.slice/crio-6cce6e9fa3b58686487a922b556b132e28b6bb88809289798104ab161f4a3ec6 WatchSource:0}: Error finding container 6cce6e9fa3b58686487a922b556b132e28b6bb88809289798104ab161f4a3ec6: Status 404 returned error can't find the container with id 6cce6e9fa3b58686487a922b556b132e28b6bb88809289798104ab161f4a3ec6
Sep 10 14:34:13.887818 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.887725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857558d647-qrhbn" event={"ID":"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c","Type":"ContainerStarted","Data":"6d1e9f58acb0526cba838c8d9a126c8b2375f271c399a0bb5c510c118c285c19"}
Sep 10 14:34:13.887818 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.887787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857558d647-qrhbn" event={"ID":"ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c","Type":"ContainerStarted","Data":"6cce6e9fa3b58686487a922b556b132e28b6bb88809289798104ab161f4a3ec6"}
Sep 10 14:34:13.905188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:13.905126    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-857558d647-qrhbn" podStartSLOduration=0.905109434 podStartE2EDuration="905.109434ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:34:13.904022279 +0000 UTC m=+368.368388814" watchObservedRunningTime="2026-09-10 14:34:13.905109434 +0000 UTC m=+368.369475956"
Sep 10 14:34:23.347392 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:23.347352    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:23.347817 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:23.347407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:23.352066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:23.352035    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:23.942255 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:23.942222    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-857558d647-qrhbn"
Sep 10 14:34:23.984351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:23.984311    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9d98ddb5-z7p7g"]
Sep 10 14:34:49.008759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.008693    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f9d98ddb5-z7p7g" podUID="cd290d95-50c3-4d02-91c3-93bf2342f7b7" containerName="console" containerID="cri-o://e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a" gracePeriod=15
Sep 10 14:34:49.262698 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.262630    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:34:49.373666 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.373618    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-oauth-serving-cert\") pod \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") "
Sep 10 14:34:49.373902 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.373733    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-config\") pod \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") "
Sep 10 14:34:49.373902 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.373815    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-oauth-config\") pod \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") "
Sep 10 14:34:49.373902 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.373853    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92kbf\" (UniqueName: \"kubernetes.io/projected/cd290d95-50c3-4d02-91c3-93bf2342f7b7-kube-api-access-92kbf\") pod \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") "
Sep 10 14:34:49.373902 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.373886    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-serving-cert\") pod \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") "
Sep 10 14:34:49.374142 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.373920    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-service-ca\") pod \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") "
Sep 10 14:34:49.374142 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.373948    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-trusted-ca-bundle\") pod \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\" (UID: \"cd290d95-50c3-4d02-91c3-93bf2342f7b7\") "
Sep 10 14:34:49.374142 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.374094    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd290d95-50c3-4d02-91c3-93bf2342f7b7" (UID: "cd290d95-50c3-4d02-91c3-93bf2342f7b7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:49.374290 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.374256    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-config" (OuterVolumeSpecName: "console-config") pod "cd290d95-50c3-4d02-91c3-93bf2342f7b7" (UID: "cd290d95-50c3-4d02-91c3-93bf2342f7b7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:49.374395 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.374372    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:34:49.374472 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.374400    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:34:49.374472 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.374411    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd290d95-50c3-4d02-91c3-93bf2342f7b7" (UID: "cd290d95-50c3-4d02-91c3-93bf2342f7b7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:49.374556 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.374494    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd290d95-50c3-4d02-91c3-93bf2342f7b7" (UID: "cd290d95-50c3-4d02-91c3-93bf2342f7b7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:49.376107 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.376085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd290d95-50c3-4d02-91c3-93bf2342f7b7" (UID: "cd290d95-50c3-4d02-91c3-93bf2342f7b7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:34:49.376517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.376496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd290d95-50c3-4d02-91c3-93bf2342f7b7" (UID: "cd290d95-50c3-4d02-91c3-93bf2342f7b7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:34:49.376624 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.376541    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd290d95-50c3-4d02-91c3-93bf2342f7b7-kube-api-access-92kbf" (OuterVolumeSpecName: "kube-api-access-92kbf") pod "cd290d95-50c3-4d02-91c3-93bf2342f7b7" (UID: "cd290d95-50c3-4d02-91c3-93bf2342f7b7"). InnerVolumeSpecName "kube-api-access-92kbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:34:49.474924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.474877    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:34:49.474924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.474918    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:34:49.474924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.474931    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd290d95-50c3-4d02-91c3-93bf2342f7b7-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:34:49.475168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.474940    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd290d95-50c3-4d02-91c3-93bf2342f7b7-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:34:49.475168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:49.474949    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92kbf\" (UniqueName: \"kubernetes.io/projected/cd290d95-50c3-4d02-91c3-93bf2342f7b7-kube-api-access-92kbf\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:34:50.063815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.063776    2561 generic.go:356] "Generic (PLEG): container finished" podID="cd290d95-50c3-4d02-91c3-93bf2342f7b7" containerID="e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a" exitCode=0
Sep 10 14:34:50.064283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.063834    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d98ddb5-z7p7g"
Sep 10 14:34:50.064283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.063857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d98ddb5-z7p7g" event={"ID":"cd290d95-50c3-4d02-91c3-93bf2342f7b7","Type":"ContainerDied","Data":"e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a"}
Sep 10 14:34:50.064283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.063913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d98ddb5-z7p7g" event={"ID":"cd290d95-50c3-4d02-91c3-93bf2342f7b7","Type":"ContainerDied","Data":"602bd376ca3def331c68598282cf50d8186d884e7a44dd30043828e2120213b1"}
Sep 10 14:34:50.064283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.063935    2561 scope.go:117] "RemoveContainer" containerID="e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a"
Sep 10 14:34:50.072561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.072537    2561 scope.go:117] "RemoveContainer" containerID="e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a"
Sep 10 14:34:50.072887 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:34:50.072869    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a\": container with ID starting with e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a not found: ID does not exist" containerID="e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a"
Sep 10 14:34:50.072952 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.072894    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a"} err="failed to get container status \"e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a\": rpc error: code = NotFound desc = could not find container \"e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a\": container with ID starting with e073f2fefb99d087a7d2d9ab5fdfb2883d636b7d7390852c0cf625e40ac4ff4a not found: ID does not exist"
Sep 10 14:34:50.089630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.089596    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9d98ddb5-z7p7g"]
Sep 10 14:34:50.099462 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:50.099433    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f9d98ddb5-z7p7g"]
Sep 10 14:34:51.993575 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:51.993536    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd290d95-50c3-4d02-91c3-93bf2342f7b7" path="/var/lib/kubelet/pods/cd290d95-50c3-4d02-91c3-93bf2342f7b7/volumes"
Sep 10 14:34:55.066640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.066591    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"]
Sep 10 14:34:55.067487 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.067462    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd290d95-50c3-4d02-91c3-93bf2342f7b7" containerName="console"
Sep 10 14:34:55.067487 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.067489    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd290d95-50c3-4d02-91c3-93bf2342f7b7" containerName="console"
Sep 10 14:34:55.067734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.067719    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd290d95-50c3-4d02-91c3-93bf2342f7b7" containerName="console"
Sep 10 14:34:55.071601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.071576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.075170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.075143    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 14:34:55.075291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.075234    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 14:34:55.075378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.075362    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kkwjv\""
Sep 10 14:34:55.103367 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.103330    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"]
Sep 10 14:34:55.126777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.126735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ea26c12-fea3-49ea-89e0-d284564190b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.126777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.126775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2j4\" (UniqueName: \"kubernetes.io/projected/5ea26c12-fea3-49ea-89e0-d284564190b9-kube-api-access-tq2j4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.228000 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.227955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ea26c12-fea3-49ea-89e0-d284564190b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.228000 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.228001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2j4\" (UniqueName: \"kubernetes.io/projected/5ea26c12-fea3-49ea-89e0-d284564190b9-kube-api-access-tq2j4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.228392 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.228366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ea26c12-fea3-49ea-89e0-d284564190b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.236785 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.236757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2j4\" (UniqueName: \"kubernetes.io/projected/5ea26c12-fea3-49ea-89e0-d284564190b9-kube-api-access-tq2j4\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.381767 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.381638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:34:55.657835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:55.657798    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"]
Sep 10 14:34:55.660419 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:34:55.660392    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea26c12_fea3_49ea_89e0_d284564190b9.slice/crio-32990cbd7d7d01e5a6df03d2d057e6e5c785eec1d62c7a605e08fd77d3478dd3 WatchSource:0}: Error finding container 32990cbd7d7d01e5a6df03d2d057e6e5c785eec1d62c7a605e08fd77d3478dd3: Status 404 returned error can't find the container with id 32990cbd7d7d01e5a6df03d2d057e6e5c785eec1d62c7a605e08fd77d3478dd3
Sep 10 14:34:56.095612 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:34:56.095455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp" event={"ID":"5ea26c12-fea3-49ea-89e0-d284564190b9","Type":"ContainerStarted","Data":"32990cbd7d7d01e5a6df03d2d057e6e5c785eec1d62c7a605e08fd77d3478dd3"}
Sep 10 14:35:00.122609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:00.122568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp" event={"ID":"5ea26c12-fea3-49ea-89e0-d284564190b9","Type":"ContainerStarted","Data":"a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b"}
Sep 10 14:35:00.123180 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:00.123152    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:35:00.147550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:00.147488    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp" podStartSLOduration=1.564679302 podStartE2EDuration="5.147473234s" totalImagesPullingTime="3.582793932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:35:00.146087234 +0000 UTC m=+414.610453757" watchObservedRunningTime="2026-09-10 14:35:00.147473234 +0000 UTC m=+414.611839752"
Sep 10 14:35:11.131848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:11.131814    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:35:13.398462 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.398424    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"]
Sep 10 14:35:13.398897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.398628    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp" podUID="5ea26c12-fea3-49ea-89e0-d284564190b9" containerName="manager" containerID="cri-o://a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b" gracePeriod=2
Sep 10 14:35:13.404896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.404850    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"]
Sep 10 14:35:13.426844 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.426810    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"]
Sep 10 14:35:13.427428 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.427396    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea26c12-fea3-49ea-89e0-d284564190b9" containerName="manager"
Sep 10 14:35:13.427428 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.427426    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea26c12-fea3-49ea-89e0-d284564190b9" containerName="manager"
Sep 10 14:35:13.427630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.427523    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea26c12-fea3-49ea-89e0-d284564190b9" containerName="manager"
Sep 10 14:35:13.431624 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.431599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.435210 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:35:13.435174    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" podUID="5ea26c12-fea3-49ea-89e0-d284564190b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:35:13.446489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.446456    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"]
Sep 10 14:35:13.509612 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.509575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qdbzb\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.509804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.509680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnr8t\" (UniqueName: \"kubernetes.io/projected/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-kube-api-access-cnr8t\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qdbzb\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.610378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.610335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnr8t\" (UniqueName: \"kubernetes.io/projected/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-kube-api-access-cnr8t\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qdbzb\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.610564 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.610484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qdbzb\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.610942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.610911    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qdbzb\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.623492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.623459    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnr8t\" (UniqueName: \"kubernetes.io/projected/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-kube-api-access-cnr8t\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qdbzb\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.648239 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.648206    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:35:13.651229 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:35:13.651163    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-jjrfp\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" podUID="5ea26c12-fea3-49ea-89e0-d284564190b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:35:13.774154 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.774108    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:13.812183 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.812137    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ea26c12-fea3-49ea-89e0-d284564190b9-extensions-socket-volume\") pod \"5ea26c12-fea3-49ea-89e0-d284564190b9\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") "
Sep 10 14:35:13.812385 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.812283    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq2j4\" (UniqueName: \"kubernetes.io/projected/5ea26c12-fea3-49ea-89e0-d284564190b9-kube-api-access-tq2j4\") pod \"5ea26c12-fea3-49ea-89e0-d284564190b9\" (UID: \"5ea26c12-fea3-49ea-89e0-d284564190b9\") "
Sep 10 14:35:13.812635 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.812599    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea26c12-fea3-49ea-89e0-d284564190b9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ea26c12-fea3-49ea-89e0-d284564190b9" (UID: "5ea26c12-fea3-49ea-89e0-d284564190b9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:35:13.814742 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.814699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea26c12-fea3-49ea-89e0-d284564190b9-kube-api-access-tq2j4" (OuterVolumeSpecName: "kube-api-access-tq2j4") pod "5ea26c12-fea3-49ea-89e0-d284564190b9" (UID: "5ea26c12-fea3-49ea-89e0-d284564190b9"). InnerVolumeSpecName "kube-api-access-tq2j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:35:13.913881 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.913785    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ea26c12-fea3-49ea-89e0-d284564190b9-extensions-socket-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:35:13.913881 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.913821    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq2j4\" (UniqueName: \"kubernetes.io/projected/5ea26c12-fea3-49ea-89e0-d284564190b9-kube-api-access-tq2j4\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:35:13.994139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:13.994104    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ea26c12-fea3-49ea-89e0-d284564190b9" path="/var/lib/kubelet/pods/5ea26c12-fea3-49ea-89e0-d284564190b9/volumes"
Sep 10 14:35:14.056854 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.056826    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"]
Sep 10 14:35:14.058484 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:35:14.058452    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee092d2_8c83_49d5_a2e8_e2d2aa9df6db.slice/crio-0407ea0d87a3334fd048581d921a9503444d7dd1e9b1e1b2149ad59185e9c4f0 WatchSource:0}: Error finding container 0407ea0d87a3334fd048581d921a9503444d7dd1e9b1e1b2149ad59185e9c4f0: Status 404 returned error can't find the container with id 0407ea0d87a3334fd048581d921a9503444d7dd1e9b1e1b2149ad59185e9c4f0
Sep 10 14:35:14.201787 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.201659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb" event={"ID":"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db","Type":"ContainerStarted","Data":"2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c"}
Sep 10 14:35:14.201787 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.201738    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb" event={"ID":"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db","Type":"ContainerStarted","Data":"0407ea0d87a3334fd048581d921a9503444d7dd1e9b1e1b2149ad59185e9c4f0"}
Sep 10 14:35:14.202008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.201789    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:14.203076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.203052    2561 generic.go:356] "Generic (PLEG): container finished" podID="5ea26c12-fea3-49ea-89e0-d284564190b9" containerID="a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b" exitCode=0
Sep 10 14:35:14.203222 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.203090    2561 scope.go:117] "RemoveContainer" containerID="a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b"
Sep 10 14:35:14.203222 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.203098    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jjrfp"
Sep 10 14:35:14.211775 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.211756    2561 scope.go:117] "RemoveContainer" containerID="a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b"
Sep 10 14:35:14.212100 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:35:14.212081    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b\": container with ID starting with a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b not found: ID does not exist" containerID="a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b"
Sep 10 14:35:14.212153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.212117    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b"} err="failed to get container status \"a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b\": rpc error: code = NotFound desc = could not find container \"a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b\": container with ID starting with a0d895e98b5ccd5d8a0abffc3cefd5454acdd4ecf1eb2430f0152fe6d94a7a3b not found: ID does not exist"
Sep 10 14:35:14.223224 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:14.223168    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb" podStartSLOduration=1.223151454 podStartE2EDuration="1.223151454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:35:14.221560954 +0000 UTC m=+428.685927481" watchObservedRunningTime="2026-09-10 14:35:14.223151454 +0000 UTC m=+428.687517976"
Sep 10 14:35:25.211412 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:25.211378    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:28.514488 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.514402    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"]
Sep 10 14:35:28.514898 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.514634    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb" podUID="4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" containerName="manager" containerID="cri-o://2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c" gracePeriod=10
Sep 10 14:35:28.768821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.768760    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:28.852128 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.852089    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-extensions-socket-volume\") pod \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") "
Sep 10 14:35:28.852329 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.852176    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnr8t\" (UniqueName: \"kubernetes.io/projected/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-kube-api-access-cnr8t\") pod \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\" (UID: \"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db\") "
Sep 10 14:35:28.852496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.852471    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" (UID: "4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:35:28.854400 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.854370    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-kube-api-access-cnr8t" (OuterVolumeSpecName: "kube-api-access-cnr8t") pod "4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" (UID: "4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db"). InnerVolumeSpecName "kube-api-access-cnr8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:35:28.892093 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.892054    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"]
Sep 10 14:35:28.892459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.892446    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" containerName="manager"
Sep 10 14:35:28.892512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.892461    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" containerName="manager"
Sep 10 14:35:28.892554 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.892523    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" containerName="manager"
Sep 10 14:35:28.894484 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.894468    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:28.926624 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.926522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"]
Sep 10 14:35:28.953171 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.953128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbkbx\" (UniqueName: \"kubernetes.io/projected/187c4f77-1bd2-425e-a1aa-648dcc6e8713-kube-api-access-xbkbx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6ckfx\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:28.953318 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.953200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/187c4f77-1bd2-425e-a1aa-648dcc6e8713-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6ckfx\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:28.953318 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.953265    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-extensions-socket-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:35:28.953318 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:28.953281    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnr8t\" (UniqueName: \"kubernetes.io/projected/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db-kube-api-access-cnr8t\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:35:29.054220 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.054128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbkbx\" (UniqueName: \"kubernetes.io/projected/187c4f77-1bd2-425e-a1aa-648dcc6e8713-kube-api-access-xbkbx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6ckfx\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:29.054220 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.054192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/187c4f77-1bd2-425e-a1aa-648dcc6e8713-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6ckfx\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:29.054585 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.054562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/187c4f77-1bd2-425e-a1aa-648dcc6e8713-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6ckfx\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:29.067376 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.067346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbkbx\" (UniqueName: \"kubernetes.io/projected/187c4f77-1bd2-425e-a1aa-648dcc6e8713-kube-api-access-xbkbx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6ckfx\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:29.204548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.204505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:29.282986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.282945    2561 generic.go:356] "Generic (PLEG): container finished" podID="4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" containerID="2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c" exitCode=0
Sep 10 14:35:29.282986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.282987    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb" event={"ID":"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db","Type":"ContainerDied","Data":"2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c"}
Sep 10 14:35:29.283351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.283027    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"
Sep 10 14:35:29.283351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.283046    2561 scope.go:117] "RemoveContainer" containerID="2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c"
Sep 10 14:35:29.283351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.283035    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb" event={"ID":"4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db","Type":"ContainerDied","Data":"0407ea0d87a3334fd048581d921a9503444d7dd1e9b1e1b2149ad59185e9c4f0"}
Sep 10 14:35:29.291561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.291540    2561 scope.go:117] "RemoveContainer" containerID="2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c"
Sep 10 14:35:29.291844 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:35:29.291818    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c\": container with ID starting with 2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c not found: ID does not exist" containerID="2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c"
Sep 10 14:35:29.291944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.291851    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c"} err="failed to get container status \"2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c\": rpc error: code = NotFound desc = could not find container \"2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c\": container with ID starting with 2f210c7746790796adfadd332e8222711bab9090eab6ab284edb4b68736db63c not found: ID does not exist"
Sep 10 14:35:29.313672 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.313620    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"]
Sep 10 14:35:29.327022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.327001    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qdbzb"]
Sep 10 14:35:29.495813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.495781    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"]
Sep 10 14:35:29.499496 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:35:29.499467    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187c4f77_1bd2_425e_a1aa_648dcc6e8713.slice/crio-27b0747045191af3ce093ad8923198aed973f4dbe9f8c36e312cfed754953669 WatchSource:0}: Error finding container 27b0747045191af3ce093ad8923198aed973f4dbe9f8c36e312cfed754953669: Status 404 returned error can't find the container with id 27b0747045191af3ce093ad8923198aed973f4dbe9f8c36e312cfed754953669
Sep 10 14:35:29.993523 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:29.993491    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db" path="/var/lib/kubelet/pods/4ee092d2-8c83-49d5-a2e8-e2d2aa9df6db/volumes"
Sep 10 14:35:30.290897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:30.290802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerStarted","Data":"63aea0c4846d2e9f1a2385401cc932cfeff7fff781b082fb1683e8708e9cfc3d"}
Sep 10 14:35:30.290897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:30.290854    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerStarted","Data":"27b0747045191af3ce093ad8923198aed973f4dbe9f8c36e312cfed754953669"}
Sep 10 14:35:30.291137 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:30.290931    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:30.324159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:30.324087    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" podStartSLOduration=2.324065649 podStartE2EDuration="2.324065649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:35:30.320063215 +0000 UTC m=+444.784429753" watchObservedRunningTime="2026-09-10 14:35:30.324065649 +0000 UTC m=+444.788432173"
Sep 10 14:35:41.298334 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:41.298302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:35:44.986847 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:44.986815    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"]
Sep 10 14:35:44.990772 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:44.990748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:44.993478 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:44.993453    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bxrfg\""
Sep 10 14:35:45.003760 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.003731    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"]
Sep 10 14:35:45.105347 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105647 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdpnv\" (UniqueName: \"kubernetes.io/projected/fcc17185-b5aa-4811-a9ef-af638d47a375-kube-api-access-gdpnv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105647 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcc17185-b5aa-4811-a9ef-af638d47a375-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105647 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105788 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.105788 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.105756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.206595 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.206812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdpnv\" (UniqueName: \"kubernetes.io/projected/fcc17185-b5aa-4811-a9ef-af638d47a375-kube-api-access-gdpnv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.206812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcc17185-b5aa-4811-a9ef-af638d47a375-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.206812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.206812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.206812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.206812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.207213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.207213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.206987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.207213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.207061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.207213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.207129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.207405 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.207359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.207451 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.207438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.207491 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.207462    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcc17185-b5aa-4811-a9ef-af638d47a375-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.209268 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.209246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.209386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.209367    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.214473 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.214453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcc17185-b5aa-4811-a9ef-af638d47a375-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.214605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.214588    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdpnv\" (UniqueName: \"kubernetes.io/projected/fcc17185-b5aa-4811-a9ef-af638d47a375-kube-api-access-gdpnv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8xwvv\" (UID: \"fcc17185-b5aa-4811-a9ef-af638d47a375\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.302288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.302189    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:45.577252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.577222    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"]
Sep 10 14:35:45.579404 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:35:45.579376    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc17185_b5aa_4811_a9ef_af638d47a375.slice/crio-754010e5c1603975cf716c1ab84fc156e975ec956464b689c4851be7cf42eaca WatchSource:0}: Error finding container 754010e5c1603975cf716c1ab84fc156e975ec956464b689c4851be7cf42eaca: Status 404 returned error can't find the container with id 754010e5c1603975cf716c1ab84fc156e975ec956464b689c4851be7cf42eaca
Sep 10 14:35:45.589036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.582296    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:35:45.589036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.582459    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:35:45.589036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:45.582540    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:35:46.373522 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:46.373478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" event={"ID":"fcc17185-b5aa-4811-a9ef-af638d47a375","Type":"ContainerStarted","Data":"e7cf5ed69c50e6536a751315b110f4a00bdf067ae68961d7ded845cc029ca43f"}
Sep 10 14:35:46.373959 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:46.373543    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" event={"ID":"fcc17185-b5aa-4811-a9ef-af638d47a375","Type":"ContainerStarted","Data":"754010e5c1603975cf716c1ab84fc156e975ec956464b689c4851be7cf42eaca"}
Sep 10 14:35:46.396600 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:46.396536    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" podStartSLOduration=2.396519165 podStartE2EDuration="2.396519165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:35:46.393739305 +0000 UTC m=+460.858105904" watchObservedRunningTime="2026-09-10 14:35:46.396519165 +0000 UTC m=+460.860885720"
Sep 10 14:35:47.303080 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:47.303044    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:47.308439 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:47.308413    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:47.379765 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:47.379728    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:47.380695 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:47.380674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:35:58.884559 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:58.884525    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-6d4x6"]
Sep 10 14:35:58.889311 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:58.889287    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6"
Sep 10 14:35:58.892110 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:58.892084    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vzdhs\""
Sep 10 14:35:58.898122 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:58.898099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-6d4x6"]
Sep 10 14:35:59.043890 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:59.043854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6s5f\" (UniqueName: \"kubernetes.io/projected/c2879c01-14e3-4bd9-9ee4-faef4165e1f3-kube-api-access-z6s5f\") pod \"authorino-7bcfd8f9cd-6d4x6\" (UID: \"c2879c01-14e3-4bd9-9ee4-faef4165e1f3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6"
Sep 10 14:35:59.144730 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:59.144604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6s5f\" (UniqueName: \"kubernetes.io/projected/c2879c01-14e3-4bd9-9ee4-faef4165e1f3-kube-api-access-z6s5f\") pod \"authorino-7bcfd8f9cd-6d4x6\" (UID: \"c2879c01-14e3-4bd9-9ee4-faef4165e1f3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6"
Sep 10 14:35:59.160113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:59.160082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6s5f\" (UniqueName: \"kubernetes.io/projected/c2879c01-14e3-4bd9-9ee4-faef4165e1f3-kube-api-access-z6s5f\") pod \"authorino-7bcfd8f9cd-6d4x6\" (UID: \"c2879c01-14e3-4bd9-9ee4-faef4165e1f3\") " pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6"
Sep 10 14:35:59.212091 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:59.212054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6"
Sep 10 14:35:59.489058 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:35:59.489034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-6d4x6"]
Sep 10 14:35:59.490836 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:35:59.490807    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2879c01_14e3_4bd9_9ee4_faef4165e1f3.slice/crio-0234b0fa86d9d85679282696d45f380343c38550ba6fbe024b5580b988ff5d39 WatchSource:0}: Error finding container 0234b0fa86d9d85679282696d45f380343c38550ba6fbe024b5580b988ff5d39: Status 404 returned error can't find the container with id 0234b0fa86d9d85679282696d45f380343c38550ba6fbe024b5580b988ff5d39
Sep 10 14:36:00.449776 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:00.449730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6" event={"ID":"c2879c01-14e3-4bd9-9ee4-faef4165e1f3","Type":"ContainerStarted","Data":"0234b0fa86d9d85679282696d45f380343c38550ba6fbe024b5580b988ff5d39"}
Sep 10 14:36:01.455965 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:01.455923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6" event={"ID":"c2879c01-14e3-4bd9-9ee4-faef4165e1f3","Type":"ContainerStarted","Data":"15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c"}
Sep 10 14:36:01.472968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:01.472914    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6" podStartSLOduration=1.851202823 podStartE2EDuration="3.472898568s" totalImagesPullingTime="1.621695745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:01.471882334 +0000 UTC m=+475.936248856" watchObservedRunningTime="2026-09-10 14:36:01.472898568 +0000 UTC m=+475.937265090"
Sep 10 14:36:01.772898 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:01.772810    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-6d4x6"]
Sep 10 14:36:03.466865 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:03.466826    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6" podUID="c2879c01-14e3-4bd9-9ee4-faef4165e1f3" containerName="authorino" containerID="cri-o://15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c" gracePeriod=30
Sep 10 14:36:03.727476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:03.727412    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6"
Sep 10 14:36:03.896571 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:03.896529    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6s5f\" (UniqueName: \"kubernetes.io/projected/c2879c01-14e3-4bd9-9ee4-faef4165e1f3-kube-api-access-z6s5f\") pod \"c2879c01-14e3-4bd9-9ee4-faef4165e1f3\" (UID: \"c2879c01-14e3-4bd9-9ee4-faef4165e1f3\") "
Sep 10 14:36:03.898714 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:03.898675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2879c01-14e3-4bd9-9ee4-faef4165e1f3-kube-api-access-z6s5f" (OuterVolumeSpecName: "kube-api-access-z6s5f") pod "c2879c01-14e3-4bd9-9ee4-faef4165e1f3" (UID: "c2879c01-14e3-4bd9-9ee4-faef4165e1f3"). InnerVolumeSpecName "kube-api-access-z6s5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:03.997463 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:03.997362    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6s5f\" (UniqueName: \"kubernetes.io/projected/c2879c01-14e3-4bd9-9ee4-faef4165e1f3-kube-api-access-z6s5f\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:36:04.473112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.473070    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2879c01-14e3-4bd9-9ee4-faef4165e1f3" containerID="15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c" exitCode=0
Sep 10 14:36:04.473112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.473117    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6"
Sep 10 14:36:04.473617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.473150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6" event={"ID":"c2879c01-14e3-4bd9-9ee4-faef4165e1f3","Type":"ContainerDied","Data":"15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c"}
Sep 10 14:36:04.473617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.473194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-6d4x6" event={"ID":"c2879c01-14e3-4bd9-9ee4-faef4165e1f3","Type":"ContainerDied","Data":"0234b0fa86d9d85679282696d45f380343c38550ba6fbe024b5580b988ff5d39"}
Sep 10 14:36:04.473617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.473212    2561 scope.go:117] "RemoveContainer" containerID="15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c"
Sep 10 14:36:04.481825 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.481789    2561 scope.go:117] "RemoveContainer" containerID="15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c"
Sep 10 14:36:04.482140 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:36:04.482120    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c\": container with ID starting with 15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c not found: ID does not exist" containerID="15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c"
Sep 10 14:36:04.482208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.482154    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c"} err="failed to get container status \"15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c\": rpc error: code = NotFound desc = could not find container \"15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c\": container with ID starting with 15c52474386e7edeca0e39f4b56988193cde635c74ca531ec15a01ab3568f33c not found: ID does not exist"
Sep 10 14:36:04.499723 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.499676    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-6d4x6"]
Sep 10 14:36:04.504546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:04.504513    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-6d4x6"]
Sep 10 14:36:05.993654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:05.993623    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2879c01-14e3-4bd9-9ee4-faef4165e1f3" path="/var/lib/kubelet/pods/c2879c01-14e3-4bd9-9ee4-faef4165e1f3/volumes"
Sep 10 14:36:14.476223 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.476189    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"]
Sep 10 14:36:14.476607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.476568    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2879c01-14e3-4bd9-9ee4-faef4165e1f3" containerName="authorino"
Sep 10 14:36:14.476607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.476579    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2879c01-14e3-4bd9-9ee4-faef4165e1f3" containerName="authorino"
Sep 10 14:36:14.476693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.476660    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2879c01-14e3-4bd9-9ee4-faef4165e1f3" containerName="authorino"
Sep 10 14:36:14.481538 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.481512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:14.484337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.484299    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 14:36:14.484517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.484449    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nq6gx\""
Sep 10 14:36:14.485543 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.485526    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:36:14.485596 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.485562    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 14:36:14.492979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.492956    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"]
Sep 10 14:36:14.594097 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.594064    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg4wp\" (UniqueName: \"kubernetes.io/projected/92cf3bbb-c861-483a-b256-5e9173241ff7-kube-api-access-hg4wp\") pod \"postgres-69fb4594cf-ln8m7\" (UID: \"92cf3bbb-c861-483a-b256-5e9173241ff7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:14.594248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.594135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92cf3bbb-c861-483a-b256-5e9173241ff7-data\") pod \"postgres-69fb4594cf-ln8m7\" (UID: \"92cf3bbb-c861-483a-b256-5e9173241ff7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:14.694908 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.694868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg4wp\" (UniqueName: \"kubernetes.io/projected/92cf3bbb-c861-483a-b256-5e9173241ff7-kube-api-access-hg4wp\") pod \"postgres-69fb4594cf-ln8m7\" (UID: \"92cf3bbb-c861-483a-b256-5e9173241ff7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:14.695093 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.694956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92cf3bbb-c861-483a-b256-5e9173241ff7-data\") pod \"postgres-69fb4594cf-ln8m7\" (UID: \"92cf3bbb-c861-483a-b256-5e9173241ff7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:14.695342 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.695321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92cf3bbb-c861-483a-b256-5e9173241ff7-data\") pod \"postgres-69fb4594cf-ln8m7\" (UID: \"92cf3bbb-c861-483a-b256-5e9173241ff7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:14.703471 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.703438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg4wp\" (UniqueName: \"kubernetes.io/projected/92cf3bbb-c861-483a-b256-5e9173241ff7-kube-api-access-hg4wp\") pod \"postgres-69fb4594cf-ln8m7\" (UID: \"92cf3bbb-c861-483a-b256-5e9173241ff7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:14.795083 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:14.794998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:15.065174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:15.065150    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"]
Sep 10 14:36:15.066945 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:36:15.066909    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92cf3bbb_c861_483a_b256_5e9173241ff7.slice/crio-2529f27262c09eaeecececc0fc6d0792cde1361d15ddcdb96cd87a5e6ec35c4d WatchSource:0}: Error finding container 2529f27262c09eaeecececc0fc6d0792cde1361d15ddcdb96cd87a5e6ec35c4d: Status 404 returned error can't find the container with id 2529f27262c09eaeecececc0fc6d0792cde1361d15ddcdb96cd87a5e6ec35c4d
Sep 10 14:36:15.528237 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:15.528203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7" event={"ID":"92cf3bbb-c861-483a-b256-5e9173241ff7","Type":"ContainerStarted","Data":"2529f27262c09eaeecececc0fc6d0792cde1361d15ddcdb96cd87a5e6ec35c4d"}
Sep 10 14:36:20.560542 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:20.560503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7" event={"ID":"92cf3bbb-c861-483a-b256-5e9173241ff7","Type":"ContainerStarted","Data":"ae473d3f6e12b6d8ce0fc5b25857e0082ba0111636ed8e496961cf9827b9b6d9"}
Sep 10 14:36:20.561066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:20.560577    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:20.577184 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:20.577133    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7" podStartSLOduration=1.7330934230000001 podStartE2EDuration="6.577117678s" totalImagesPullingTime="4.844024255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:20.574413835 +0000 UTC m=+495.038780358" watchObservedRunningTime="2026-09-10 14:36:20.577117678 +0000 UTC m=+495.041484200"
Sep 10 14:36:26.596449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:26.596416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ln8m7"
Sep 10 14:36:27.163641 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.163603    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-9cv7f"]
Sep 10 14:36:27.169678 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.169651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9cv7f"
Sep 10 14:36:27.172340 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.172312    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vzdhs\""
Sep 10 14:36:27.173380 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.173354    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-9cv7f"]
Sep 10 14:36:27.224012 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.223980    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-9cv7f"]
Sep 10 14:36:27.224315 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:36:27.224295    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hjc7c], unattached volumes=[], failed to process volumes=[kube-api-access-hjc7c]: context canceled" pod="kuadrant-system/authorino-557f876f69-9cv7f" podUID="9de04a61-e632-46b6-a3ab-95af55e023e5"
Sep 10 14:36:27.250303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.250266    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-w8sn8"]
Sep 10 14:36:27.254132 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.254111    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.256826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.256801    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 14:36:27.263444 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.263412    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-w8sn8"]
Sep 10 14:36:27.319943 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.319904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwmt\" (UniqueName: \"kubernetes.io/projected/6efad37e-2f07-49ac-9a3f-1d358966a4b8-kube-api-access-4wwmt\") pod \"authorino-6d4dfc649f-w8sn8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") " pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.320152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.319971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjc7c\" (UniqueName: \"kubernetes.io/projected/9de04a61-e632-46b6-a3ab-95af55e023e5-kube-api-access-hjc7c\") pod \"authorino-557f876f69-9cv7f\" (UID: \"9de04a61-e632-46b6-a3ab-95af55e023e5\") " pod="kuadrant-system/authorino-557f876f69-9cv7f"
Sep 10 14:36:27.320152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.320069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6efad37e-2f07-49ac-9a3f-1d358966a4b8-tls-cert\") pod \"authorino-6d4dfc649f-w8sn8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") " pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.407094 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.407059    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-w8sn8"]
Sep 10 14:36:27.407413 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:36:27.407393    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4wwmt tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-w8sn8" podUID="6efad37e-2f07-49ac-9a3f-1d358966a4b8"
Sep 10 14:36:27.421389 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.421315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6efad37e-2f07-49ac-9a3f-1d358966a4b8-tls-cert\") pod \"authorino-6d4dfc649f-w8sn8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") " pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.421389 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.421380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwmt\" (UniqueName: \"kubernetes.io/projected/6efad37e-2f07-49ac-9a3f-1d358966a4b8-kube-api-access-4wwmt\") pod \"authorino-6d4dfc649f-w8sn8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") " pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.421589 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.421416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjc7c\" (UniqueName: \"kubernetes.io/projected/9de04a61-e632-46b6-a3ab-95af55e023e5-kube-api-access-hjc7c\") pod \"authorino-557f876f69-9cv7f\" (UID: \"9de04a61-e632-46b6-a3ab-95af55e023e5\") " pod="kuadrant-system/authorino-557f876f69-9cv7f"
Sep 10 14:36:27.424080 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.424055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6efad37e-2f07-49ac-9a3f-1d358966a4b8-tls-cert\") pod \"authorino-6d4dfc649f-w8sn8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") " pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.432827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.432795    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjc7c\" (UniqueName: \"kubernetes.io/projected/9de04a61-e632-46b6-a3ab-95af55e023e5-kube-api-access-hjc7c\") pod \"authorino-557f876f69-9cv7f\" (UID: \"9de04a61-e632-46b6-a3ab-95af55e023e5\") " pod="kuadrant-system/authorino-557f876f69-9cv7f"
Sep 10 14:36:27.434449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.434424    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b47db549-828xg"]
Sep 10 14:36:27.435380 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.435357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwmt\" (UniqueName: \"kubernetes.io/projected/6efad37e-2f07-49ac-9a3f-1d358966a4b8-kube-api-access-4wwmt\") pod \"authorino-6d4dfc649f-w8sn8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") " pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.438334 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.438311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.445381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.445351    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b47db549-828xg"]
Sep 10 14:36:27.522646 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.522606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqmft\" (UniqueName: \"kubernetes.io/projected/84080b4c-0174-48d6-92ce-dd0addc758be-kube-api-access-zqmft\") pod \"authorino-8b47db549-828xg\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") " pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.522856 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.522783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84080b4c-0174-48d6-92ce-dd0addc758be-tls-cert\") pod \"authorino-8b47db549-828xg\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") " pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.594342 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.594308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.594520 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.594307    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9cv7f"
Sep 10 14:36:27.623551 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.623520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84080b4c-0174-48d6-92ce-dd0addc758be-tls-cert\") pod \"authorino-8b47db549-828xg\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") " pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.623942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.623560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:27.623942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.623580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqmft\" (UniqueName: \"kubernetes.io/projected/84080b4c-0174-48d6-92ce-dd0addc758be-kube-api-access-zqmft\") pod \"authorino-8b47db549-828xg\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") " pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.626082 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.626056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84080b4c-0174-48d6-92ce-dd0addc758be-tls-cert\") pod \"authorino-8b47db549-828xg\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") " pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.634489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.634460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqmft\" (UniqueName: \"kubernetes.io/projected/84080b4c-0174-48d6-92ce-dd0addc758be-kube-api-access-zqmft\") pod \"authorino-8b47db549-828xg\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") " pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.636109 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.636085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9cv7f"
Sep 10 14:36:27.724455 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.724365    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wwmt\" (UniqueName: \"kubernetes.io/projected/6efad37e-2f07-49ac-9a3f-1d358966a4b8-kube-api-access-4wwmt\") pod \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") "
Sep 10 14:36:27.724455 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.724454    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6efad37e-2f07-49ac-9a3f-1d358966a4b8-tls-cert\") pod \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\" (UID: \"6efad37e-2f07-49ac-9a3f-1d358966a4b8\") "
Sep 10 14:36:27.724627 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.724520    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjc7c\" (UniqueName: \"kubernetes.io/projected/9de04a61-e632-46b6-a3ab-95af55e023e5-kube-api-access-hjc7c\") pod \"9de04a61-e632-46b6-a3ab-95af55e023e5\" (UID: \"9de04a61-e632-46b6-a3ab-95af55e023e5\") "
Sep 10 14:36:27.726588 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.726551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6efad37e-2f07-49ac-9a3f-1d358966a4b8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6efad37e-2f07-49ac-9a3f-1d358966a4b8" (UID: "6efad37e-2f07-49ac-9a3f-1d358966a4b8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:36:27.726731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.726621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9de04a61-e632-46b6-a3ab-95af55e023e5-kube-api-access-hjc7c" (OuterVolumeSpecName: "kube-api-access-hjc7c") pod "9de04a61-e632-46b6-a3ab-95af55e023e5" (UID: "9de04a61-e632-46b6-a3ab-95af55e023e5"). InnerVolumeSpecName "kube-api-access-hjc7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:27.726731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.726651    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efad37e-2f07-49ac-9a3f-1d358966a4b8-kube-api-access-4wwmt" (OuterVolumeSpecName: "kube-api-access-4wwmt") pod "6efad37e-2f07-49ac-9a3f-1d358966a4b8" (UID: "6efad37e-2f07-49ac-9a3f-1d358966a4b8"). InnerVolumeSpecName "kube-api-access-4wwmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:27.765863 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.765817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:36:27.825550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.825515    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wwmt\" (UniqueName: \"kubernetes.io/projected/6efad37e-2f07-49ac-9a3f-1d358966a4b8-kube-api-access-4wwmt\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:36:27.825550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.825547    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6efad37e-2f07-49ac-9a3f-1d358966a4b8-tls-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:36:27.825550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:27.825558    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjc7c\" (UniqueName: \"kubernetes.io/projected/9de04a61-e632-46b6-a3ab-95af55e023e5-kube-api-access-hjc7c\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:36:28.038031 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.037996    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b47db549-828xg"]
Sep 10 14:36:28.041567 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:36:28.041534    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84080b4c_0174_48d6_92ce_dd0addc758be.slice/crio-c11792076fd36cbfdea0e4d83cadbd680457096f44cea20c2d3cfb14542ee92c WatchSource:0}: Error finding container c11792076fd36cbfdea0e4d83cadbd680457096f44cea20c2d3cfb14542ee92c: Status 404 returned error can't find the container with id c11792076fd36cbfdea0e4d83cadbd680457096f44cea20c2d3cfb14542ee92c
Sep 10 14:36:28.601022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.600981    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9cv7f"
Sep 10 14:36:28.601022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.601014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-w8sn8"
Sep 10 14:36:28.601187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.600988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b47db549-828xg" event={"ID":"84080b4c-0174-48d6-92ce-dd0addc758be","Type":"ContainerStarted","Data":"c11792076fd36cbfdea0e4d83cadbd680457096f44cea20c2d3cfb14542ee92c"}
Sep 10 14:36:28.650874 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.650845    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-w8sn8"]
Sep 10 14:36:28.654006 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.653977    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-w8sn8"]
Sep 10 14:36:28.675352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.675272    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-9cv7f"]
Sep 10 14:36:28.677995 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:28.677961    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-9cv7f"]
Sep 10 14:36:29.607471 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:29.607434    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b47db549-828xg" event={"ID":"84080b4c-0174-48d6-92ce-dd0addc758be","Type":"ContainerStarted","Data":"e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0"}
Sep 10 14:36:29.623185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:29.623134    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8b47db549-828xg" podStartSLOduration=2.088240773 podStartE2EDuration="2.623117849s" totalImagesPullingTime="534.877076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:29.62094382 +0000 UTC m=+504.085310342" watchObservedRunningTime="2026-09-10 14:36:29.623117849 +0000 UTC m=+504.087484416"
Sep 10 14:36:29.993982 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:29.993945    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6efad37e-2f07-49ac-9a3f-1d358966a4b8" path="/var/lib/kubelet/pods/6efad37e-2f07-49ac-9a3f-1d358966a4b8/volumes"
Sep 10 14:36:29.994351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:36:29.994183    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9de04a61-e632-46b6-a3ab-95af55e023e5" path="/var/lib/kubelet/pods/9de04a61-e632-46b6-a3ab-95af55e023e5/volumes"
Sep 10 14:37:23.887489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:23.887455    2561 generic.go:356] "Generic (PLEG): container finished" podID="fcc17185-b5aa-4811-a9ef-af638d47a375" containerID="e7cf5ed69c50e6536a751315b110f4a00bdf067ae68961d7ded845cc029ca43f" exitCode=0
Sep 10 14:37:23.887489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:23.887497    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" event={"ID":"fcc17185-b5aa-4811-a9ef-af638d47a375","Type":"ContainerDied","Data":"e7cf5ed69c50e6536a751315b110f4a00bdf067ae68961d7ded845cc029ca43f"}
Sep 10 14:37:23.887999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:23.887919    2561 scope.go:117] "RemoveContainer" containerID="e7cf5ed69c50e6536a751315b110f4a00bdf067ae68961d7ded845cc029ca43f"
Sep 10 14:37:23.889036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:23.888998    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:37:23.889162 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:23.889088    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:37:23.889162 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:23.889135    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:37:24.894308 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:24.894273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" event={"ID":"fcc17185-b5aa-4811-a9ef-af638d47a375","Type":"ContainerStarted","Data":"55e171b07d1144cbbba8ae68f7f9b838b19840bd7c4628a86e3d49514bc47e78"}
Sep 10 14:37:25.302962 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:25.302925    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:37:25.303174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:25.303149    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8xwvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:37:25.303223 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:25.303200    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" podUID="fcc17185-b5aa-4811-a9ef-af638d47a375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 14:37:26.303401 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:26.303363    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8xwvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:37:26.303817 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:26.303434    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" podUID="fcc17185-b5aa-4811-a9ef-af638d47a375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 14:37:27.303169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:27.303130    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8xwvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:37:27.303379 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:27.303220    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" podUID="fcc17185-b5aa-4811-a9ef-af638d47a375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 14:37:28.303036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:28.302996    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8xwvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:37:28.303418 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:28.303067    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" podUID="fcc17185-b5aa-4811-a9ef-af638d47a375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 14:37:29.303398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:29.303361    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8xwvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:37:29.303806 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:29.303418    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv" podUID="fcc17185-b5aa-4811-a9ef-af638d47a375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 14:37:30.307588 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:30.307554    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:37:30.308062 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:30.307830    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:37:30.308553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:30.308535    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8xwvv"
Sep 10 14:37:39.636470 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.636433    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"]
Sep 10 14:37:39.640219 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.640197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.643827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.643802    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 14:37:39.643988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.643832    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 14:37:39.643988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.643879    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 14:37:39.643988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.643801    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tw2h4\""
Sep 10 14:37:39.649968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.649944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"]
Sep 10 14:37:39.749857 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.749821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.749857 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.749859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw7mz\" (UniqueName: \"kubernetes.io/projected/956eb6a5-07fd-4092-a9c5-3388193fff18-kube-api-access-pw7mz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.750170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.749891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.750170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.749984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.750170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.750030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/956eb6a5-07fd-4092-a9c5-3388193fff18-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.750170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.750054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.850966 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.850924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/956eb6a5-07fd-4092-a9c5-3388193fff18-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.850966 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.850969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.851191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.851019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.851191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.851040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw7mz\" (UniqueName: \"kubernetes.io/projected/956eb6a5-07fd-4092-a9c5-3388193fff18-kube-api-access-pw7mz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.851191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.851079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.851191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.851132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.851494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.851469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.851566 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.851493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.851566 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.851512    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.853378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.853358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/956eb6a5-07fd-4092-a9c5-3388193fff18-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.853592 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.853573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/956eb6a5-07fd-4092-a9c5-3388193fff18-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.859011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.858990    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw7mz\" (UniqueName: \"kubernetes.io/projected/956eb6a5-07fd-4092-a9c5-3388193fff18-kube-api-access-pw7mz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj\" (UID: \"956eb6a5-07fd-4092-a9c5-3388193fff18\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:39.951601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:39.951556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:40.230932 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:40.230904    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"]
Sep 10 14:37:40.233473 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:37:40.233446    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956eb6a5_07fd_4092_a9c5_3388193fff18.slice/crio-c3578b71e2fb85200429309bedf6fd8accf1a53253ab0bd3600a0318c6aecb63 WatchSource:0}: Error finding container c3578b71e2fb85200429309bedf6fd8accf1a53253ab0bd3600a0318c6aecb63: Status 404 returned error can't find the container with id c3578b71e2fb85200429309bedf6fd8accf1a53253ab0bd3600a0318c6aecb63
Sep 10 14:37:40.979158 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:40.979117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj" event={"ID":"956eb6a5-07fd-4092-a9c5-3388193fff18","Type":"ContainerStarted","Data":"c3578b71e2fb85200429309bedf6fd8accf1a53253ab0bd3600a0318c6aecb63"}
Sep 10 14:37:41.986306 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:41.986267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj" event={"ID":"956eb6a5-07fd-4092-a9c5-3388193fff18","Type":"ContainerStarted","Data":"8acf37495673ff953ab910244f4ffb0d9540747afd57ba1937fe6cbc96a068b9"}
Sep 10 14:37:42.003496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:42.003438    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj" podStartSLOduration=1.87334993 podStartE2EDuration="3.003421974s" totalImagesPullingTime="1.130072044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:42.001623644 +0000 UTC m=+576.465990192" watchObservedRunningTime="2026-09-10 14:37:42.003421974 +0000 UTC m=+576.467788495"
Sep 10 14:37:49.952228 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:49.952182    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:49.952638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:49.952324    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:49.964766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:49.964734    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:37:50.037254 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:37:50.037226    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj"
Sep 10 14:38:28.141574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.141539    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"]
Sep 10 14:38:28.144787 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.144767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.147304 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.147285    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 14:38:28.158133 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.158015    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"]
Sep 10 14:38:28.228814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.228777    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.228814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.228819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.229046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.228849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.229046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.228891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.229046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.229018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0272b91-e109-46a2-8e25-305228bf4bd5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.229154 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.229075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz6z7\" (UniqueName: \"kubernetes.io/projected/f0272b91-e109-46a2-8e25-305228bf4bd5-kube-api-access-lz6z7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330217 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330217 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330585 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0272b91-e109-46a2-8e25-305228bf4bd5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330585 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz6z7\" (UniqueName: \"kubernetes.io/projected/f0272b91-e109-46a2-8e25-305228bf4bd5-kube-api-access-lz6z7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330750 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.330833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.330811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.331028 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.331007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.332492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.332466    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0272b91-e109-46a2-8e25-305228bf4bd5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.332992 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.332968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0272b91-e109-46a2-8e25-305228bf4bd5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.338932 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.338914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz6z7\" (UniqueName: \"kubernetes.io/projected/f0272b91-e109-46a2-8e25-305228bf4bd5-kube-api-access-lz6z7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf\" (UID: \"f0272b91-e109-46a2-8e25-305228bf4bd5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.464206 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.464171    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:28.734615 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.734583    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"]
Sep 10 14:38:28.736324 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:38:28.736289    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0272b91_e109_46a2_8e25_305228bf4bd5.slice/crio-c4a6fb0d519c9cbd7164060109d7f4297d3e429dd91d5c60c097ff1995ee4dca WatchSource:0}: Error finding container c4a6fb0d519c9cbd7164060109d7f4297d3e429dd91d5c60c097ff1995ee4dca: Status 404 returned error can't find the container with id c4a6fb0d519c9cbd7164060109d7f4297d3e429dd91d5c60c097ff1995ee4dca
Sep 10 14:38:28.737744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:28.737725    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:38:29.236615 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:29.236579    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf" event={"ID":"f0272b91-e109-46a2-8e25-305228bf4bd5","Type":"ContainerStarted","Data":"75ae3e051cd6185d89e668c21962ff4bc1a9840e8d436e05fb26f7f9c6fed35f"}
Sep 10 14:38:29.237036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:29.236633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf" event={"ID":"f0272b91-e109-46a2-8e25-305228bf4bd5","Type":"ContainerStarted","Data":"c4a6fb0d519c9cbd7164060109d7f4297d3e429dd91d5c60c097ff1995ee4dca"}
Sep 10 14:38:29.254570 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:29.254465    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf" podStartSLOduration=1.069907488 podStartE2EDuration="1.254449233s" totalImagesPullingTime="184.541745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:38:29.252282362 +0000 UTC m=+623.716648886" watchObservedRunningTime="2026-09-10 14:38:29.254449233 +0000 UTC m=+623.718815755"
Sep 10 14:38:38.464377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:38.464316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:38.464833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:38.464419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:38.477454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:38.477423    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:39.298961 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:39.298928    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf"
Sep 10 14:38:53.315898 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.315861    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"]
Sep 10 14:38:53.319287 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.319262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.321967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.321939    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 14:38:53.329166 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.328734    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"]
Sep 10 14:38:53.368697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.368658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.368697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.368697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566nt\" (UniqueName: \"kubernetes.io/projected/d5887ffb-712c-4199-9fe5-34e9040a41f0-kube-api-access-566nt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.368999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.368853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.368999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.368897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5887ffb-712c-4199-9fe5-34e9040a41f0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.368999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.368956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.369152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.369048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.469915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.469876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.469915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.469933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.470197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.469953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566nt\" (UniqueName: \"kubernetes.io/projected/d5887ffb-712c-4199-9fe5-34e9040a41f0-kube-api-access-566nt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.470197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.470034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.470197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.470066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5887ffb-712c-4199-9fe5-34e9040a41f0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.470197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.470102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.470410 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.470388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.470457 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.470424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.470457 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.470431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.472375 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.472354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5887ffb-712c-4199-9fe5-34e9040a41f0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.472750 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.472728    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5887ffb-712c-4199-9fe5-34e9040a41f0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.480439 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.480400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566nt\" (UniqueName: \"kubernetes.io/projected/d5887ffb-712c-4199-9fe5-34e9040a41f0-kube-api-access-566nt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm\" (UID: \"d5887ffb-712c-4199-9fe5-34e9040a41f0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.633659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.633564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:38:53.910424 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:53.910398    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"]
Sep 10 14:38:53.911989 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:38:53.911956    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5887ffb_712c_4199_9fe5_34e9040a41f0.slice/crio-7f44218ad74560a792e44d2f9bc0cc57b03cbd1fb0ad7f2c621b6d7724819ab2 WatchSource:0}: Error finding container 7f44218ad74560a792e44d2f9bc0cc57b03cbd1fb0ad7f2c621b6d7724819ab2: Status 404 returned error can't find the container with id 7f44218ad74560a792e44d2f9bc0cc57b03cbd1fb0ad7f2c621b6d7724819ab2
Sep 10 14:38:54.369577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:54.369479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm" event={"ID":"d5887ffb-712c-4199-9fe5-34e9040a41f0","Type":"ContainerStarted","Data":"758829ba08a10a902e01208484acb9e4d0ea9bc0b6c1996e46fb7e7443092e8c"}
Sep 10 14:38:54.369577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:54.369536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm" event={"ID":"d5887ffb-712c-4199-9fe5-34e9040a41f0","Type":"ContainerStarted","Data":"7f44218ad74560a792e44d2f9bc0cc57b03cbd1fb0ad7f2c621b6d7724819ab2"}
Sep 10 14:38:54.386374 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:38:54.386327    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm" podStartSLOduration=1.201075802 podStartE2EDuration="1.386311641s" totalImagesPullingTime="185.235839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:38:54.385530354 +0000 UTC m=+648.849896872" watchObservedRunningTime="2026-09-10 14:38:54.386311641 +0000 UTC m=+648.850678162"
Sep 10 14:39:03.634122 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:39:03.634089    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:39:03.634714 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:39:03.634176    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:39:03.647376 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:39:03.647345    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:39:04.434913 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:39:04.434874    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm"
Sep 10 14:40:05.794766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:05.794677    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-677cc6cd44-ccq75"]
Sep 10 14:40:05.798422 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:05.798405    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:05.807818 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:05.807787    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-677cc6cd44-ccq75"]
Sep 10 14:40:05.920265 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:05.920231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq9qf\" (UniqueName: \"kubernetes.io/projected/46f02395-dd8f-4612-9f25-54c70204b5fd-kube-api-access-hq9qf\") pod \"authorino-677cc6cd44-ccq75\" (UID: \"46f02395-dd8f-4612-9f25-54c70204b5fd\") " pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:05.920454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:05.920301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46f02395-dd8f-4612-9f25-54c70204b5fd-tls-cert\") pod \"authorino-677cc6cd44-ccq75\" (UID: \"46f02395-dd8f-4612-9f25-54c70204b5fd\") " pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:06.021882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:06.021842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq9qf\" (UniqueName: \"kubernetes.io/projected/46f02395-dd8f-4612-9f25-54c70204b5fd-kube-api-access-hq9qf\") pod \"authorino-677cc6cd44-ccq75\" (UID: \"46f02395-dd8f-4612-9f25-54c70204b5fd\") " pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:06.022046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:06.021918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46f02395-dd8f-4612-9f25-54c70204b5fd-tls-cert\") pod \"authorino-677cc6cd44-ccq75\" (UID: \"46f02395-dd8f-4612-9f25-54c70204b5fd\") " pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:06.024392 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:06.024363    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46f02395-dd8f-4612-9f25-54c70204b5fd-tls-cert\") pod \"authorino-677cc6cd44-ccq75\" (UID: \"46f02395-dd8f-4612-9f25-54c70204b5fd\") " pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:06.032291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:06.032261    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq9qf\" (UniqueName: \"kubernetes.io/projected/46f02395-dd8f-4612-9f25-54c70204b5fd-kube-api-access-hq9qf\") pod \"authorino-677cc6cd44-ccq75\" (UID: \"46f02395-dd8f-4612-9f25-54c70204b5fd\") " pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:06.108773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:06.108657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-677cc6cd44-ccq75"
Sep 10 14:40:06.386819 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:06.386790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-677cc6cd44-ccq75"]
Sep 10 14:40:06.388529 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:06.388501    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46f02395_dd8f_4612_9f25_54c70204b5fd.slice/crio-bc54ae1b0d16dc66b0e107901a830d4095b06b59cedaf3cfb41179de6d24a8cb WatchSource:0}: Error finding container bc54ae1b0d16dc66b0e107901a830d4095b06b59cedaf3cfb41179de6d24a8cb: Status 404 returned error can't find the container with id bc54ae1b0d16dc66b0e107901a830d4095b06b59cedaf3cfb41179de6d24a8cb
Sep 10 14:40:06.758453 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:06.758416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-677cc6cd44-ccq75" event={"ID":"46f02395-dd8f-4612-9f25-54c70204b5fd","Type":"ContainerStarted","Data":"bc54ae1b0d16dc66b0e107901a830d4095b06b59cedaf3cfb41179de6d24a8cb"}
Sep 10 14:40:07.767380 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:07.767279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-677cc6cd44-ccq75" event={"ID":"46f02395-dd8f-4612-9f25-54c70204b5fd","Type":"ContainerStarted","Data":"d422ff21958aaca411a18b3f37a2ec74e3134a1e1cde1657dbada9c181f4e8f0"}
Sep 10 14:40:07.822554 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:07.822494    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-677cc6cd44-ccq75" podStartSLOduration=1.698631832 podStartE2EDuration="2.822476572s" totalImagesPullingTime="1.12384474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:07.822122538 +0000 UTC m=+722.286489064" watchObservedRunningTime="2026-09-10 14:40:07.822476572 +0000 UTC m=+722.286843093"
Sep 10 14:40:07.878074 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:07.878036    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b47db549-828xg"]
Sep 10 14:40:07.878543 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:07.878273    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8b47db549-828xg" podUID="84080b4c-0174-48d6-92ce-dd0addc758be" containerName="authorino" containerID="cri-o://e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0" gracePeriod=30
Sep 10 14:40:08.160359 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.160332    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:40:08.245720 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.245674    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84080b4c-0174-48d6-92ce-dd0addc758be-tls-cert\") pod \"84080b4c-0174-48d6-92ce-dd0addc758be\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") "
Sep 10 14:40:08.245916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.245808    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqmft\" (UniqueName: \"kubernetes.io/projected/84080b4c-0174-48d6-92ce-dd0addc758be-kube-api-access-zqmft\") pod \"84080b4c-0174-48d6-92ce-dd0addc758be\" (UID: \"84080b4c-0174-48d6-92ce-dd0addc758be\") "
Sep 10 14:40:08.248085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.248047    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84080b4c-0174-48d6-92ce-dd0addc758be-kube-api-access-zqmft" (OuterVolumeSpecName: "kube-api-access-zqmft") pod "84080b4c-0174-48d6-92ce-dd0addc758be" (UID: "84080b4c-0174-48d6-92ce-dd0addc758be"). InnerVolumeSpecName "kube-api-access-zqmft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:08.257871 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.257840    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84080b4c-0174-48d6-92ce-dd0addc758be-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "84080b4c-0174-48d6-92ce-dd0addc758be" (UID: "84080b4c-0174-48d6-92ce-dd0addc758be"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:40:08.347893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.347787    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/84080b4c-0174-48d6-92ce-dd0addc758be-tls-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:40:08.348120 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.348101    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqmft\" (UniqueName: \"kubernetes.io/projected/84080b4c-0174-48d6-92ce-dd0addc758be-kube-api-access-zqmft\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:40:08.773717 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.773673    2561 generic.go:356] "Generic (PLEG): container finished" podID="84080b4c-0174-48d6-92ce-dd0addc758be" containerID="e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0" exitCode=0
Sep 10 14:40:08.774198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.773738    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b47db549-828xg"
Sep 10 14:40:08.774198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.773762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b47db549-828xg" event={"ID":"84080b4c-0174-48d6-92ce-dd0addc758be","Type":"ContainerDied","Data":"e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0"}
Sep 10 14:40:08.774198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.773811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b47db549-828xg" event={"ID":"84080b4c-0174-48d6-92ce-dd0addc758be","Type":"ContainerDied","Data":"c11792076fd36cbfdea0e4d83cadbd680457096f44cea20c2d3cfb14542ee92c"}
Sep 10 14:40:08.774198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.773838    2561 scope.go:117] "RemoveContainer" containerID="e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0"
Sep 10 14:40:08.783462 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.783440    2561 scope.go:117] "RemoveContainer" containerID="e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0"
Sep 10 14:40:08.783844 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:40:08.783823    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0\": container with ID starting with e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0 not found: ID does not exist" containerID="e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0"
Sep 10 14:40:08.783904 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.783854    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0"} err="failed to get container status \"e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0\": rpc error: code = NotFound desc = could not find container \"e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0\": container with ID starting with e64d13563352269ab20c4a9949e652da4b72b103a829bf0586d0bafcad4e72e0 not found: ID does not exist"
Sep 10 14:40:08.832283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.832239    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b47db549-828xg"]
Sep 10 14:40:08.836768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:08.836733    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b47db549-828xg"]
Sep 10 14:40:09.993617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:09.993580    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84080b4c-0174-48d6-92ce-dd0addc758be" path="/var/lib/kubelet/pods/84080b4c-0174-48d6-92ce-dd0addc758be/volumes"
Sep 10 14:40:25.537306 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.537269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"]
Sep 10 14:40:25.537866 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.537848    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84080b4c-0174-48d6-92ce-dd0addc758be" containerName="authorino"
Sep 10 14:40:25.537921 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.537867    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="84080b4c-0174-48d6-92ce-dd0addc758be" containerName="authorino"
Sep 10 14:40:25.537956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.537944    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="84080b4c-0174-48d6-92ce-dd0addc758be" containerName="authorino"
Sep 10 14:40:25.542515 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.542490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.545093 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.545069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5121f4-openshift-default-dockercfg-2fszz\""
Sep 10 14:40:25.553541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.553510    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"]
Sep 10 14:40:25.603511 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.603467    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"]
Sep 10 14:40:25.607563 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.607526    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.610266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.610237    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-9b1e67-openshift-default-dockercfg-pcl5t\""
Sep 10 14:40:25.618454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.618419    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"]
Sep 10 14:40:25.674582 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.674549    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"]
Sep 10 14:40:25.678298 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.678267    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.680883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.680856    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-5b0323-openshift-default-dockercfg-dgccq\""
Sep 10 14:40:25.690429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.690393    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"]
Sep 10 14:40:25.735303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-podinfo\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-podinfo\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.735512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-token\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.735512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvbjg\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-kube-api-access-bvbjg\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.735512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istiod-ca-cert\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-token\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735743 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-credential-socket\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.735743 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735635    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-certs\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735743 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-envoy\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735743 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-envoy\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.735743 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istiod-ca-cert\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.735951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-credential-socket\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-data\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.735951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-socket\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7jjd\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-kube-api-access-c7jjd\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.735951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-certs\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.736214 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.735986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-data\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.736214 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.736036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-socket\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.836924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-token\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.836988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-credential-socket\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-data\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-socket\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-certs\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-envoy\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837196    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-token\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-podinfo\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-envoy\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istiod-ca-cert\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-credential-socket\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxrq6\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-kube-api-access-xxrq6\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-data\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-socket\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837433    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7jjd\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-kube-api-access-c7jjd\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-credential-socket\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-certs\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-data\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-certs\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-socket\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-credential-socket\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.837831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-credential-socket\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.838361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.837853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-socket\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.838361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-data\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.838361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838112    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-data\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.838361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-socket\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.838361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-podinfo\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.838361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838329    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-certs\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istiod-ca-cert\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-podinfo\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-token\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istiod-ca-cert\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.838995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-envoy\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.839036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-certs\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.839069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvbjg\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-kube-api-access-bvbjg\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.839335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.839098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istiod-ca-cert\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.839882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.839803    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istiod-ca-cert\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.840972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.840945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-envoy\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.841217 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.841176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-envoy\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.841337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.841285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-podinfo\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.842190 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.842163    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-podinfo\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.852296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.852016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-token\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.852296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.852156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7jjd\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-kube-api-access-c7jjd\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.853025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.852977    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvbjg\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-kube-api-access-bvbjg\") pod \"e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") " pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.853407 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.853380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-token\") pod \"e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") " pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.853969 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.853948    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:25.921774 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.921487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:25.939934 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.939895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-data\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.939952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-socket\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.939989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-token\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.940017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-podinfo\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.940057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrq6\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-kube-api-access-xxrq6\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.940164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-credential-socket\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.940254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istiod-ca-cert\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.940283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-envoy\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.940323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-certs\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.940553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.940524    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-data\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.946253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.945557    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-certs\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.946253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.945784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-credential-socket\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.946638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.946605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-socket\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.947240 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.947184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istiod-ca-cert\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.949557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.949507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-envoy\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.950192 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.950150    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-podinfo\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.957050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.957012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxrq6\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-kube-api-access-xxrq6\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.959301 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.959270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-token\") pod \"e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") " pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:25.994575 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:25.994348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:26.141821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.141789    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"]
Sep 10 14:40:26.144198 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:26.144161    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bde40c_7b82_4a56_95c2_d2e94a414d7d.slice/crio-384bcc8c1e81bea042e0d0e47688821bfe9df5872bd494e6da2639497327082f WatchSource:0}: Error finding container 384bcc8c1e81bea042e0d0e47688821bfe9df5872bd494e6da2639497327082f: Status 404 returned error can't find the container with id 384bcc8c1e81bea042e0d0e47688821bfe9df5872bd494e6da2639497327082f
Sep 10 14:40:26.146540 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.146502    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.146643 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.146592    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.146643 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.146636    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.223020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.222974    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"]
Sep 10 14:40:26.224920 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:26.224884    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810d68f6_1cc8_45a2_9cd5_344b2e1636db.slice/crio-daa245839fa0545066ca72f79a4828466233cd6c324ceb9d3d537f85a8f9ddb6 WatchSource:0}: Error finding container daa245839fa0545066ca72f79a4828466233cd6c324ceb9d3d537f85a8f9ddb6: Status 404 returned error can't find the container with id daa245839fa0545066ca72f79a4828466233cd6c324ceb9d3d537f85a8f9ddb6
Sep 10 14:40:26.227477 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.227439    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.227658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.227528    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.227658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.227570    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.281366 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.281335    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"]
Sep 10 14:40:26.282955 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:26.282931    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ca73e8_b1fb_4f16_8379_b3eb02d61dfc.slice/crio-9c9836d59ff2ce839a7598e1a353104d55bb3c264d14e16aa94ce60662a85ec8 WatchSource:0}: Error finding container 9c9836d59ff2ce839a7598e1a353104d55bb3c264d14e16aa94ce60662a85ec8: Status 404 returned error can't find the container with id 9c9836d59ff2ce839a7598e1a353104d55bb3c264d14e16aa94ce60662a85ec8
Sep 10 14:40:26.286157 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.286113    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.286241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.286212    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.286290 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.286266    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:26.879512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.879470    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" event={"ID":"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc","Type":"ContainerStarted","Data":"e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209"}
Sep 10 14:40:26.879975 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.879537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" event={"ID":"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc","Type":"ContainerStarted","Data":"9c9836d59ff2ce839a7598e1a353104d55bb3c264d14e16aa94ce60662a85ec8"}
Sep 10 14:40:26.881194 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.881169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" event={"ID":"f9bde40c-7b82-4a56-95c2-d2e94a414d7d","Type":"ContainerStarted","Data":"5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf"}
Sep 10 14:40:26.881323 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.881220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" event={"ID":"f9bde40c-7b82-4a56-95c2-d2e94a414d7d","Type":"ContainerStarted","Data":"384bcc8c1e81bea042e0d0e47688821bfe9df5872bd494e6da2639497327082f"}
Sep 10 14:40:26.882813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.882789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" event={"ID":"810d68f6-1cc8-45a2-9cd5-344b2e1636db","Type":"ContainerStarted","Data":"7de6a1afe16d95cde62d5be03c363db25a3edad6a887754bb3fdceba18a9aea0"}
Sep 10 14:40:26.882898 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.882834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" event={"ID":"810d68f6-1cc8-45a2-9cd5-344b2e1636db","Type":"ContainerStarted","Data":"daa245839fa0545066ca72f79a4828466233cd6c324ceb9d3d537f85a8f9ddb6"}
Sep 10 14:40:26.916789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.916727    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podStartSLOduration=1.916682723 podStartE2EDuration="1.916682723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:26.915075366 +0000 UTC m=+741.379441890" watchObservedRunningTime="2026-09-10 14:40:26.916682723 +0000 UTC m=+741.381049245"
Sep 10 14:40:26.922149 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.922116    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:26.963925 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.963874    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podStartSLOduration=1.963857425 podStartE2EDuration="1.963857425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:26.961449065 +0000 UTC m=+741.425815612" watchObservedRunningTime="2026-09-10 14:40:26.963857425 +0000 UTC m=+741.428223948"
Sep 10 14:40:26.993688 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.993623    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podStartSLOduration=1.9936049489999998 podStartE2EDuration="1.993604949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:26.99231343 +0000 UTC m=+741.456679952" watchObservedRunningTime="2026-09-10 14:40:26.993604949 +0000 UTC m=+741.457971524"
Sep 10 14:40:26.994894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:26.994868    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:27.854889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:27.854841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:27.860946 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:27.860916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:27.889182 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:27.889087    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:27.890125 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:27.890100    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:27.929573 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:27.929538    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:28.000555 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:28.000522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:28.895781 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:28.895750    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:28.896243 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:28.895809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:28.896612 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:28.896585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:28.896751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:28.896682    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:32.841300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:32.841258    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"]
Sep 10 14:40:32.851524 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:32.851411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:32.854763 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:32.854734    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-5121f4-dockercfg-8v454\""
Sep 10 14:40:32.855175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:32.855072    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-5121f4\""
Sep 10 14:40:32.856313 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:32.856286    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"]
Sep 10 14:40:32.917813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:32.917773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txhsf\" (UniqueName: \"kubernetes.io/projected/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-kube-api-access-txhsf\") pod \"payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:32.918147 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:32.918125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:33.019382 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:33.019337    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txhsf\" (UniqueName: \"kubernetes.io/projected/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-kube-api-access-txhsf\") pod \"payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:33.019571 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:33.019392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:33.020237 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:33.020217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:33.027049 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:33.027016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txhsf\" (UniqueName: \"kubernetes.io/projected/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-kube-api-access-txhsf\") pod \"payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:33.166546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:33.166503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:33.443648 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:33.443626    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"]
Sep 10 14:40:33.446358 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:33.446313    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d0ff71_1f88_40a5_9b2d_2f2c5cf46160.slice/crio-c1d6dfda22669a3b608762ec5b57bf58320396aeba54d24cdc2e62745ece34b4 WatchSource:0}: Error finding container c1d6dfda22669a3b608762ec5b57bf58320396aeba54d24cdc2e62745ece34b4: Status 404 returned error can't find the container with id c1d6dfda22669a3b608762ec5b57bf58320396aeba54d24cdc2e62745ece34b4
Sep 10 14:40:33.935811 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:33.935495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4" event={"ID":"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160","Type":"ContainerStarted","Data":"c1d6dfda22669a3b608762ec5b57bf58320396aeba54d24cdc2e62745ece34b4"}
Sep 10 14:40:34.299781 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.299650    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"]
Sep 10 14:40:34.305723 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.305678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.308845 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.308695    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c2ce1a1c-openshift-default-dockercfg-jn2l9\""
Sep 10 14:40:34.316360 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.316329    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"]
Sep 10 14:40:34.339479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.339411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ntx\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-kube-api-access-w6ntx\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.339756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.339487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-certs\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.339756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.339527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2d3561-a054-43b8-96a8-c230e061b808-istiod-ca-cert\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.339756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.339555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-istio-token\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.339756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.339591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-envoy\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.339756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.339616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-data\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.339756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.339650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2d3561-a054-43b8-96a8-c230e061b808-istio-podinfo\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.361738 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.361018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-credential-socket\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.361738 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.361184    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-socket\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.471734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-envoy\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.471734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-data\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.471734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2d3561-a054-43b8-96a8-c230e061b808-istio-podinfo\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.471734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-credential-socket\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.471734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-socket\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.471734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ntx\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-kube-api-access-w6ntx\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.471734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-certs\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.472254 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2d3561-a054-43b8-96a8-c230e061b808-istiod-ca-cert\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.472254 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.471806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-istio-token\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.473221 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.473197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-socket\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.473539 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.473475    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2d3561-a054-43b8-96a8-c230e061b808-istiod-ca-cert\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.482768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.473799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-data\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.482768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.473950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-credential-socket\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.482768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.474180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-certs\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.482768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.475375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-envoy\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.485733 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.484193    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-istio-token\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.485733 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.484936    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2d3561-a054-43b8-96a8-c230e061b808-istio-podinfo\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.491734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.487791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ntx\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-kube-api-access-w6ntx\") pod \"e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") " pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.639784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.639013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:34.977913 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.977881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"]
Sep 10 14:40:34.979281 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:34.979250    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2d3561_a054_43b8_96a8_c230e061b808.slice/crio-30dd3e591c7bff4421d08a8aa7f8b977cc044e207e8f842e51d117046e7696f7 WatchSource:0}: Error finding container 30dd3e591c7bff4421d08a8aa7f8b977cc044e207e8f842e51d117046e7696f7: Status 404 returned error can't find the container with id 30dd3e591c7bff4421d08a8aa7f8b977cc044e207e8f842e51d117046e7696f7
Sep 10 14:40:34.981821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.981779    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:34.981914 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.981871    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:34.981980 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:34.981914    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:35.963579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:35.963520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" event={"ID":"6c2d3561-a054-43b8-96a8-c230e061b808","Type":"ContainerStarted","Data":"6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85"}
Sep 10 14:40:35.963811 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:35.963661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" event={"ID":"6c2d3561-a054-43b8-96a8-c230e061b808","Type":"ContainerStarted","Data":"30dd3e591c7bff4421d08a8aa7f8b977cc044e207e8f842e51d117046e7696f7"}
Sep 10 14:40:35.984426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:35.984344    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podStartSLOduration=1.9843277110000002 podStartE2EDuration="1.984327711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:35.982179786 +0000 UTC m=+750.446546309" watchObservedRunningTime="2026-09-10 14:40:35.984327711 +0000 UTC m=+750.448694227"
Sep 10 14:40:36.640166 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:36.640070    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:36.649878 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:36.649845    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:36.971918 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:36.971830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4" event={"ID":"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160","Type":"ContainerStarted","Data":"c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e"}
Sep 10 14:40:36.972255 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:36.972230    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:36.972363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:36.972285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:36.973521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:36.973498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:36.987607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:36.987550    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4" podStartSLOduration=1.575474456 podStartE2EDuration="4.987534869s" totalImagesPullingTime="3.412060413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:36.986720952 +0000 UTC m=+751.451087476" watchObservedRunningTime="2026-09-10 14:40:36.987534869 +0000 UTC m=+751.451901390"
Sep 10 14:40:39.090697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.090653    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"]
Sep 10 14:40:39.094846 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.094823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.097542 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.097513    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c2ce1a1c-dockercfg-6c9pd\""
Sep 10 14:40:39.097676 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.097513    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c2ce1a1c\""
Sep 10 14:40:39.102174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.102145    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"]
Sep 10 14:40:39.243658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.243606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd537eea-6828-410d-8ca2-4e7b318442a8-plugins-config-volume\") pod \"payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") " pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.243904 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.243717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582vv\" (UniqueName: \"kubernetes.io/projected/cd537eea-6828-410d-8ca2-4e7b318442a8-kube-api-access-582vv\") pod \"payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") " pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.344890 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.344777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd537eea-6828-410d-8ca2-4e7b318442a8-plugins-config-volume\") pod \"payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") " pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.344890 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.344868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582vv\" (UniqueName: \"kubernetes.io/projected/cd537eea-6828-410d-8ca2-4e7b318442a8-kube-api-access-582vv\") pod \"payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") " pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.346309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.346277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd537eea-6828-410d-8ca2-4e7b318442a8-plugins-config-volume\") pod \"payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") " pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.352988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.352965    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-582vv\" (UniqueName: \"kubernetes.io/projected/cd537eea-6828-410d-8ca2-4e7b318442a8-kube-api-access-582vv\") pod \"payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") " pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.406869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.406833    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.696063 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.696035    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"]
Sep 10 14:40:39.697815 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:39.697769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd537eea_6828_410d_8ca2_4e7b318442a8.slice/crio-08bfc36479879b53f5cacc46abdd39350954c7aa0952786be2eb420863ae2281 WatchSource:0}: Error finding container 08bfc36479879b53f5cacc46abdd39350954c7aa0952786be2eb420863ae2281: Status 404 returned error can't find the container with id 08bfc36479879b53f5cacc46abdd39350954c7aa0952786be2eb420863ae2281
Sep 10 14:40:39.995809 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.995776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:39.996005 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.995831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9" event={"ID":"cd537eea-6828-410d-8ca2-4e7b318442a8","Type":"ContainerStarted","Data":"af9cc620aa6447e08253f89537747eb05b5bee881498232a837fca31812c859c"}
Sep 10 14:40:39.996005 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:39.995855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9" event={"ID":"cd537eea-6828-410d-8ca2-4e7b318442a8","Type":"ContainerStarted","Data":"08bfc36479879b53f5cacc46abdd39350954c7aa0952786be2eb420863ae2281"}
Sep 10 14:40:40.012572 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:40.012517    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9" podStartSLOduration=1.012500449 podStartE2EDuration="1.012500449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:40.010413808 +0000 UTC m=+754.474780331" watchObservedRunningTime="2026-09-10 14:40:40.012500449 +0000 UTC m=+754.476866971"
Sep 10 14:40:41.721000 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.720967    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"]
Sep 10 14:40:41.725280 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.725257    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.728041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.728012    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-22fb28-openshift-default-dockercfg-wrdhz\""
Sep 10 14:40:41.738892 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.738852    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"]
Sep 10 14:40:41.875338 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-data\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875338 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istiod-ca-cert\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875586 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-token\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875586 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875546    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-credential-socket\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875586 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-socket\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875762 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-certs\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875762 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-envoy\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875878 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvxtd\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-kube-api-access-jvxtd\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.875878 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.875831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-podinfo\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.976664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-token\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.976664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-credential-socket\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.976664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-socket\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-certs\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-envoy\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvxtd\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-kube-api-access-jvxtd\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-podinfo\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-data\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.976924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istiod-ca-cert\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977324 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.977134    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-credential-socket\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977324 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.977224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-socket\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977832 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.977798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istiod-ca-cert\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977980 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.977903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-certs\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.977980 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.977947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-data\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.979689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.979659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-podinfo\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.979817 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.979698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-envoy\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.985524 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.985497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-token\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:41.985698 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:41.985675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvxtd\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-kube-api-access-jvxtd\") pod \"e2e-autores-22fb28-openshift-default-566dd574c8-r58hl\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") " pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:42.039889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:42.039855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:42.318759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:42.318731    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"]
Sep 10 14:40:42.322429 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:40:42.320682    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf23eb0_4c8f_4a3d_912d_870ae3da35fe.slice/crio-c022652e290fa8d28462aa78951766cf43b5105fe5751bc48d3e4d05ea0b8fc2 WatchSource:0}: Error finding container c022652e290fa8d28462aa78951766cf43b5105fe5751bc48d3e4d05ea0b8fc2: Status 404 returned error can't find the container with id c022652e290fa8d28462aa78951766cf43b5105fe5751bc48d3e4d05ea0b8fc2
Sep 10 14:40:42.323681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:42.323639    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:42.323856 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:42.323766    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:42.323856 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:42.323817    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:43.016347 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.016316    2561 generic.go:356] "Generic (PLEG): container finished" podID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerID="e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209" exitCode=0
Sep 10 14:40:43.016823 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.016393    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" event={"ID":"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc","Type":"ContainerDied","Data":"e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209"}
Sep 10 14:40:43.016938 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.016912    2561 scope.go:117] "RemoveContainer" containerID="e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209"
Sep 10 14:40:43.018130 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.018099    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:43.018248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.018176    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:43.018248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.018202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" event={"ID":"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe","Type":"ContainerStarted","Data":"a745027573c3f2067d6523aa280fd4557839031ed5ceb41185609f1d93de4458"}
Sep 10 14:40:43.018248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.018213    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:43.018248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.018243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" event={"ID":"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe","Type":"ContainerStarted","Data":"c022652e290fa8d28462aa78951766cf43b5105fe5751bc48d3e4d05ea0b8fc2"}
Sep 10 14:40:43.040185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.040118    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:43.046840 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.046811    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:43.058630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.058537    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podStartSLOduration=2.058515446 podStartE2EDuration="2.058515446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:43.056736534 +0000 UTC m=+757.521103053" watchObservedRunningTime="2026-09-10 14:40:43.058515446 +0000 UTC m=+757.522881968"
Sep 10 14:40:43.896016 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:43.895970    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:44.033517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:44.033480    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" event={"ID":"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc","Type":"ContainerStarted","Data":"3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035"}
Sep 10 14:40:44.034104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:44.034082    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:44.038476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:44.038449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:40:44.994825 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:44.994789    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:44.995784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:44.995746    2561 patch_prober.go:28] interesting pod/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:40:44.995931 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:44.995821    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 14:40:45.995488 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:45.995440    2561 patch_prober.go:28] interesting pod/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:40:45.997797 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:45.995517    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 14:40:46.995759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:46.995691    2561 patch_prober.go:28] interesting pod/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:40:46.996245 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:46.995781    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 14:40:47.996479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:47.996047    2561 patch_prober.go:28] interesting pod/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:40:47.996479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:47.996108    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 14:40:48.988941 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:48.988897    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:40:48.995503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:48.995100    2561 patch_prober.go:28] interesting pod/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:40:48.995503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:48.995157    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 14:40:49.995255 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:49.995207    2561 patch_prober.go:28] interesting pod/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:40:49.995787 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:49.995276    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 14:40:51.001063 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:50.999854    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:51.001063 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:51.000921    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:51.001850 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:51.001802    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:40:51.003217 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:51.003200    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:40:53.013912 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:53.013863    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:40:53.014411 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:53.013945    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:40:57.212797 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.212764    2561 generic.go:356] "Generic (PLEG): container finished" podID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerID="5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf" exitCode=0
Sep 10 14:40:57.213266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.212837    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" event={"ID":"f9bde40c-7b82-4a56-95c2-d2e94a414d7d","Type":"ContainerDied","Data":"5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf"}
Sep 10 14:40:57.213431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.213414    2561 scope.go:117] "RemoveContainer" containerID="5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf"
Sep 10 14:40:57.214734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.214697    2561 generic.go:356] "Generic (PLEG): container finished" podID="6c2d3561-a054-43b8-96a8-c230e061b808" containerID="6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85" exitCode=0
Sep 10 14:40:57.214734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.214692    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.214883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.214737    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" event={"ID":"6c2d3561-a054-43b8-96a8-c230e061b808","Type":"ContainerDied","Data":"6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85"}
Sep 10 14:40:57.214883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.214790    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.214883 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.214831    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.215178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.215151    2561 scope.go:117] "RemoveContainer" containerID="6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85"
Sep 10 14:40:57.216438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.216405    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.216561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.216473    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.216561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.216511    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.216718 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.216681    2561 generic.go:356] "Generic (PLEG): container finished" podID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerID="7de6a1afe16d95cde62d5be03c363db25a3edad6a887754bb3fdceba18a9aea0" exitCode=0
Sep 10 14:40:57.216782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.216744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" event={"ID":"810d68f6-1cc8-45a2-9cd5-344b2e1636db","Type":"ContainerDied","Data":"7de6a1afe16d95cde62d5be03c363db25a3edad6a887754bb3fdceba18a9aea0"}
Sep 10 14:40:57.217138 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.217119    2561 scope.go:117] "RemoveContainer" containerID="7de6a1afe16d95cde62d5be03c363db25a3edad6a887754bb3fdceba18a9aea0"
Sep 10 14:40:57.218293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.218257    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.218383 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.218332    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.218383 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.218370    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:40:57.889554 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:57.889519    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:58.227308 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.227021    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" event={"ID":"810d68f6-1cc8-45a2-9cd5-344b2e1636db","Type":"ContainerStarted","Data":"bd94d6e050dd114824d428f0f0aba8b79e07308111fec09f37ea4e31964865b2"}
Sep 10 14:40:58.232530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.232491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" event={"ID":"f9bde40c-7b82-4a56-95c2-d2e94a414d7d","Type":"ContainerStarted","Data":"e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee"}
Sep 10 14:40:58.236575 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.236542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" event={"ID":"6c2d3561-a054-43b8-96a8-c230e061b808","Type":"ContainerStarted","Data":"bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9"}
Sep 10 14:40:58.640681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.640148    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:40:58.640889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.640553    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:40:58.641112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.641067    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 14:40:58.856132 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.856090    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:40:58.856511 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.856485    2561 patch_prober.go:28] interesting pod/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 14:40:58.856741 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.856695    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 14:40:58.895625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.895519    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:58.923677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.923644    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:40:58.924054 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.924027    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:40:58.924232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:58.924205    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 14:40:59.635305 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.635256    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"]
Sep 10 14:40:59.638993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.638960    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.640044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.640013    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:40:59.640273 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.640230    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 14:40:59.644170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.644145    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2dccd5-openshift-default-dockercfg-bwvwp\""
Sep 10 14:40:59.672657 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.672628    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"]
Sep 10 14:40:59.776728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-token\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.776728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-socket\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.776728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776544    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-data\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.776728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-credential-socket\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.777114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsd7v\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-kube-api-access-bsd7v\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.777114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-podinfo\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.777114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-certs\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.777114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-envoy\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.777114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.776939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c4dc1d0-b220-44ad-9c01-306bb7320657-istiod-ca-cert\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.855375 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.855208    2561 patch_prober.go:28] interesting pod/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 14:40:59.855375 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.855282    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 14:40:59.878567 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.878514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-socket\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.878936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.878911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-data\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.879139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.879121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-credential-socket\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.879285 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.879268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsd7v\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-kube-api-access-bsd7v\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.879412 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.879397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-podinfo\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.879560 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.879546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-certs\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.879686 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.879673    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-envoy\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.879838 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.879822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c4dc1d0-b220-44ad-9c01-306bb7320657-istiod-ca-cert\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.879997 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.879982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-token\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.880942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.880911    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-socket\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.881326 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.881309    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-data\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.881759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.881741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-credential-socket\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.883112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.883086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-certs\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.883915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.883893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c4dc1d0-b220-44ad-9c01-306bb7320657-istiod-ca-cert\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.888370 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.888294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-podinfo\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.892578 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.892547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsd7v\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-kube-api-access-bsd7v\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.893272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.893180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-token\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.897517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.897452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-envoy\") pod \"e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") " pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:40:59.923611 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.922451    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:40:59.923611 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.922518    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 14:40:59.987567 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:40:59.987520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:00.574578 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.574459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"]
Sep 10 14:41:00.602409 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:41:00.602356    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4dc1d0_b220_44ad_9c01_306bb7320657.slice/crio-e44153bffff75fe9bd16fc5842ff8e058ab9d529a1d74b718d90b4ce51f3027f WatchSource:0}: Error finding container e44153bffff75fe9bd16fc5842ff8e058ab9d529a1d74b718d90b4ce51f3027f: Status 404 returned error can't find the container with id e44153bffff75fe9bd16fc5842ff8e058ab9d529a1d74b718d90b4ce51f3027f
Sep 10 14:41:00.610025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.609969    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:00.610171 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.610070    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:00.610171 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.610117    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:00.640570 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.640544    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:41:00.641470 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.641040    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 14:41:00.855041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.854933    2561 patch_prober.go:28] interesting pod/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 14:41:00.855041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.855004    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 14:41:00.924729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.924116    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:00.924729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:00.924186    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 14:41:01.267681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.267639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" event={"ID":"7c4dc1d0-b220-44ad-9c01-306bb7320657","Type":"ContainerStarted","Data":"6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b"}
Sep 10 14:41:01.268027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.267998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" event={"ID":"7c4dc1d0-b220-44ad-9c01-306bb7320657","Type":"ContainerStarted","Data":"e44153bffff75fe9bd16fc5842ff8e058ab9d529a1d74b718d90b4ce51f3027f"}
Sep 10 14:41:01.293762 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.293679    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podStartSLOduration=2.2936527829999998 podStartE2EDuration="2.293652783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:01.290018642 +0000 UTC m=+775.754385166" watchObservedRunningTime="2026-09-10 14:41:01.293652783 +0000 UTC m=+775.758019306"
Sep 10 14:41:01.639922 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.639821    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:41:01.640175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.640149    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 14:41:01.855110 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.855054    2561 patch_prober.go:28] interesting pod/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 14:41:01.855728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.855675    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 14:41:01.922730 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.922655    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:01.923042 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:01.923010    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 14:41:02.002548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.002438    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:02.008686 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.008642    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:02.278931 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.278825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:02.283119 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.283080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:02.640830 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.640721    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:41:02.640830 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.640796    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 14:41:02.793423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.793375    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"]
Sep 10 14:41:02.798153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.798119    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"
Sep 10 14:41:02.804815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.804783    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:41:02.816447 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.816413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"]
Sep 10 14:41:02.858224 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.858182    2561 patch_prober.go:28] interesting pod/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 14:41:02.858896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.858849    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 14:41:02.886576 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.886536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/918b6f20-04de-482a-b6c5-a5f8ff7e25d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8\" (UID: \"918b6f20-04de-482a-b6c5-a5f8ff7e25d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"
Sep 10 14:41:02.923197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.923156    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:02.923484 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.923459    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 14:41:02.987869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.987818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/918b6f20-04de-482a-b6c5-a5f8ff7e25d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8\" (UID: \"918b6f20-04de-482a-b6c5-a5f8ff7e25d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"
Sep 10 14:41:02.990801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:02.989783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/918b6f20-04de-482a-b6c5-a5f8ff7e25d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8\" (UID: \"918b6f20-04de-482a-b6c5-a5f8ff7e25d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"
Sep 10 14:41:03.117128 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.117091    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"
Sep 10 14:41:03.707794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.644093    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:41:03.707794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.644159    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 14:41:03.714252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.714224    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"]
Sep 10 14:41:03.717247 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:41:03.717201    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918b6f20_04de_482a_b6c5_a5f8ff7e25d9.slice/crio-451714ec00b573a6619866020e68c0f3cdb42ab2f10073d406d9c3787c6a9599 WatchSource:0}: Error finding container 451714ec00b573a6619866020e68c0f3cdb42ab2f10073d406d9c3787c6a9599: Status 404 returned error can't find the container with id 451714ec00b573a6619866020e68c0f3cdb42ab2f10073d406d9c3787c6a9599
Sep 10 14:41:03.855465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.855418    2561 patch_prober.go:28] interesting pod/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 14:41:03.855652 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.855495    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 14:41:03.923855 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.923334    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:03.923855 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:03.923406    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 14:41:04.344732 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.337656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8" event={"ID":"918b6f20-04de-482a-b6c5-a5f8ff7e25d9","Type":"ContainerStarted","Data":"451714ec00b573a6619866020e68c0f3cdb42ab2f10073d406d9c3787c6a9599"}
Sep 10 14:41:04.640156 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.640052    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:41:04.640156 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.640122    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 14:41:04.860678 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.860646    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:41:04.861100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.861071    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:41:04.861994 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.861971    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:41:04.937634 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.936090    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:41:04.941561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:04.941477    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:41:05.645621 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:05.645591    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:41:05.646076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:05.646055    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:41:05.646905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:05.646880    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:41:07.358280 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:07.358235    2561 generic.go:356] "Generic (PLEG): container finished" podID="918b6f20-04de-482a-b6c5-a5f8ff7e25d9" containerID="85fea973d31bd4e81025230af253f60819e62e36d7f6880708edc618b0f9f72d" exitCode=0
Sep 10 14:41:07.358696 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:07.358335    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8" event={"ID":"918b6f20-04de-482a-b6c5-a5f8ff7e25d9","Type":"ContainerDied","Data":"85fea973d31bd4e81025230af253f60819e62e36d7f6880708edc618b0f9f72d"}
Sep 10 14:41:08.365308 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.365274    2561 generic.go:356] "Generic (PLEG): container finished" podID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerID="a745027573c3f2067d6523aa280fd4557839031ed5ceb41185609f1d93de4458" exitCode=0
Sep 10 14:41:08.365804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.365348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" event={"ID":"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe","Type":"ContainerDied","Data":"a745027573c3f2067d6523aa280fd4557839031ed5ceb41185609f1d93de4458"}
Sep 10 14:41:08.366086 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.365833    2561 scope.go:117] "RemoveContainer" containerID="a745027573c3f2067d6523aa280fd4557839031ed5ceb41185609f1d93de4458"
Sep 10 14:41:08.367048 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.367015    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:08.367139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.367086    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:08.367139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.367121    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:08.525777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.525742    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"
Sep 10 14:41:08.578960 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.578915    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/918b6f20-04de-482a-b6c5-a5f8ff7e25d9-maas-api-service-ca\") pod \"918b6f20-04de-482a-b6c5-a5f8ff7e25d9\" (UID: \"918b6f20-04de-482a-b6c5-a5f8ff7e25d9\") "
Sep 10 14:41:08.579283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.579258    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918b6f20-04de-482a-b6c5-a5f8ff7e25d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "918b6f20-04de-482a-b6c5-a5f8ff7e25d9" (UID: "918b6f20-04de-482a-b6c5-a5f8ff7e25d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:08.680693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:08.680653    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/918b6f20-04de-482a-b6c5-a5f8ff7e25d9-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:09.373514 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:09.373473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" event={"ID":"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe","Type":"ContainerStarted","Data":"6865240118aa8ec663ebfc7e83ac2841582293168fd56f508e22bc0729007b1f"}
Sep 10 14:41:09.374949 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:09.374931    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"
Sep 10 14:41:09.375043 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:09.374979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8" event={"ID":"918b6f20-04de-482a-b6c5-a5f8ff7e25d9","Type":"ContainerDied","Data":"451714ec00b573a6619866020e68c0f3cdb42ab2f10073d406d9c3787c6a9599"}
Sep 10 14:41:09.375043 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:09.375021    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="451714ec00b573a6619866020e68c0f3cdb42ab2f10073d406d9c3787c6a9599"
Sep 10 14:41:10.040308 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:10.040265    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:41:10.041829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:10.041798    2561 patch_prober.go:28] interesting pod/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 14:41:10.042077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:10.042049    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 14:41:11.041079 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:11.041027    2561 patch_prober.go:28] interesting pod/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 14:41:11.041573 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:11.041103    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 14:41:12.040779 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:12.040738    2561 patch_prober.go:28] interesting pod/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 14:41:12.041094 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:12.041061    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 14:41:13.041419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:13.041376    2561 patch_prober.go:28] interesting pod/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 14:41:13.042117 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:13.042075    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 14:41:14.033804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:14.033764    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:41:14.040528 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:14.040491    2561 patch_prober.go:28] interesting pod/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 14:41:14.040849 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:14.040819    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 14:41:15.044822 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:15.044789    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:41:15.045941 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:15.045919    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:41:19.273245 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.273207    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"]
Sep 10 14:41:19.273801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.273415    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9" podUID="cd537eea-6828-410d-8ca2-4e7b318442a8" containerName="payload-processing" containerID="cri-o://af9cc620aa6447e08253f89537747eb05b5bee881498232a837fca31812c859c" gracePeriod=30
Sep 10 14:41:19.457732 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.455794    2561 generic.go:356] "Generic (PLEG): container finished" podID="cd537eea-6828-410d-8ca2-4e7b318442a8" containerID="af9cc620aa6447e08253f89537747eb05b5bee881498232a837fca31812c859c" exitCode=0
Sep 10 14:41:19.457732 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.455998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9" event={"ID":"cd537eea-6828-410d-8ca2-4e7b318442a8","Type":"ContainerDied","Data":"af9cc620aa6447e08253f89537747eb05b5bee881498232a837fca31812c859c"}
Sep 10 14:41:19.553454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.553266    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"]
Sep 10 14:41:19.557259 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.557206    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2ce1a1c-4htg8"]
Sep 10 14:41:19.598673 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.598648    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:41:19.663981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.663921    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"]
Sep 10 14:41:19.664929 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.664869    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" containerID="cri-o://bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9" gracePeriod=30
Sep 10 14:41:19.705126 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.705089    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd537eea-6828-410d-8ca2-4e7b318442a8-plugins-config-volume\") pod \"cd537eea-6828-410d-8ca2-4e7b318442a8\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") "
Sep 10 14:41:19.705328 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.705198    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-582vv\" (UniqueName: \"kubernetes.io/projected/cd537eea-6828-410d-8ca2-4e7b318442a8-kube-api-access-582vv\") pod \"cd537eea-6828-410d-8ca2-4e7b318442a8\" (UID: \"cd537eea-6828-410d-8ca2-4e7b318442a8\") "
Sep 10 14:41:19.705563 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.705526    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd537eea-6828-410d-8ca2-4e7b318442a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd537eea-6828-410d-8ca2-4e7b318442a8" (UID: "cd537eea-6828-410d-8ca2-4e7b318442a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:19.709732 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.708191    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd537eea-6828-410d-8ca2-4e7b318442a8-kube-api-access-582vv" (OuterVolumeSpecName: "kube-api-access-582vv") pod "cd537eea-6828-410d-8ca2-4e7b318442a8" (UID: "cd537eea-6828-410d-8ca2-4e7b318442a8"). InnerVolumeSpecName "kube-api-access-582vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:19.807091 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.806997    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd537eea-6828-410d-8ca2-4e7b318442a8-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:19.807091 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.807032    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-582vv\" (UniqueName: \"kubernetes.io/projected/cd537eea-6828-410d-8ca2-4e7b318442a8-kube-api-access-582vv\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:19.994844 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:19.994809    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="918b6f20-04de-482a-b6c5-a5f8ff7e25d9" path="/var/lib/kubelet/pods/918b6f20-04de-482a-b6c5-a5f8ff7e25d9/volumes"
Sep 10 14:41:20.463303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.463263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9" event={"ID":"cd537eea-6828-410d-8ca2-4e7b318442a8","Type":"ContainerDied","Data":"08bfc36479879b53f5cacc46abdd39350954c7aa0952786be2eb420863ae2281"}
Sep 10 14:41:20.463697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.463353    2561 scope.go:117] "RemoveContainer" containerID="af9cc620aa6447e08253f89537747eb05b5bee881498232a837fca31812c859c"
Sep 10 14:41:20.463697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.463481    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"
Sep 10 14:41:20.493922 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.493887    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"]
Sep 10 14:41:20.502594 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.502565    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c2ce1a1c-55c5f6c657-gn8g9"]
Sep 10 14:41:20.649307 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.649264    2561 patch_prober.go:28] interesting pod/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 14:41:20.649507 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.649349    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:41:20.661792 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.661751    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"]
Sep 10 14:41:20.662788 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.662761    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="918b6f20-04de-482a-b6c5-a5f8ff7e25d9" containerName="revoke-keys"
Sep 10 14:41:20.662942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.662930    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="918b6f20-04de-482a-b6c5-a5f8ff7e25d9" containerName="revoke-keys"
Sep 10 14:41:20.663098 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.663086    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd537eea-6828-410d-8ca2-4e7b318442a8" containerName="payload-processing"
Sep 10 14:41:20.663190 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.663178    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd537eea-6828-410d-8ca2-4e7b318442a8" containerName="payload-processing"
Sep 10 14:41:20.663384 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.663372    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="918b6f20-04de-482a-b6c5-a5f8ff7e25d9" containerName="revoke-keys"
Sep 10 14:41:20.663459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.663452    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd537eea-6828-410d-8ca2-4e7b318442a8" containerName="payload-processing"
Sep 10 14:41:20.667907 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.667886    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.670829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.670811    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-42b72890-gw-openshift-default-dockercfg-j2c6k\""
Sep 10 14:41:20.677244 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.677217    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"]
Sep 10 14:41:20.716658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716571    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-certs\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-token\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-envoy\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-data\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-socket\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdl4z\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-kube-api-access-xdl4z\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-credential-socket\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istiod-ca-cert\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.716999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.716958    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-podinfo\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818255 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-envoy\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818255 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-data\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-socket\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdl4z\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-kube-api-access-xdl4z\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-credential-socket\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istiod-ca-cert\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818803 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-podinfo\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818803 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-certs\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.818803 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.818640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-token\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.819745 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.819687    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-credential-socket\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.822168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.819948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-data\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.822168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.820227    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-socket\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.822168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.821040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-certs\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.822168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.821788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istiod-ca-cert\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.825059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.825038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-envoy\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.847647 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.847568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-token\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.847835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.847667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-podinfo\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.856459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.856392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdl4z\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-kube-api-access-xdl4z\") pod \"e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") " pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:20.981154 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:20.981059    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:21.284663 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.284629    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"]
Sep 10 14:41:21.285870 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:41:21.285842    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1cf474_778a_49ae_8327_ad3be40cc6c0.slice/crio-f556f0b5628e1b0f1681d206d5b81f5b8549085ee46a27641fd4f2d6b0bb0be4 WatchSource:0}: Error finding container f556f0b5628e1b0f1681d206d5b81f5b8549085ee46a27641fd4f2d6b0bb0be4: Status 404 returned error can't find the container with id f556f0b5628e1b0f1681d206d5b81f5b8549085ee46a27641fd4f2d6b0bb0be4
Sep 10 14:41:21.288331 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.288298    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:21.288409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.288369    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:21.288409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.288402    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:21.471748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.471677    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" event={"ID":"ab1cf474-778a-49ae-8327-ad3be40cc6c0","Type":"ContainerStarted","Data":"612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8"}
Sep 10 14:41:21.472168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.471781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" event={"ID":"ab1cf474-778a-49ae-8327-ad3be40cc6c0","Type":"ContainerStarted","Data":"f556f0b5628e1b0f1681d206d5b81f5b8549085ee46a27641fd4f2d6b0bb0be4"}
Sep 10 14:41:21.494277 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.494208    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" podStartSLOduration=1.494184886 podStartE2EDuration="1.494184886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:21.48992727 +0000 UTC m=+795.954293795" watchObservedRunningTime="2026-09-10 14:41:21.494184886 +0000 UTC m=+795.958551410"
Sep 10 14:41:21.981916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.981872    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:21.994491 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:21.994453    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd537eea-6828-410d-8ca2-4e7b318442a8" path="/var/lib/kubelet/pods/cd537eea-6828-410d-8ca2-4e7b318442a8/volumes"
Sep 10 14:41:22.986423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:22.986389    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:23.484848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:23.484818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:23.485912 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:23.485886    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:24.954624 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:24.954591    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:41:25.084842 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.084803    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-socket\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.084842 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.084843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2d3561-a054-43b8-96a8-c230e061b808-istiod-ca-cert\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.084868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6ntx\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-kube-api-access-w6ntx\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.084886    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-envoy\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.084919    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2d3561-a054-43b8-96a8-c230e061b808-istio-podinfo\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.084945    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-certs\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.084978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-credential-socket\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-istio-token\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085052    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-data\") pod \"6c2d3561-a054-43b8-96a8-c230e061b808\" (UID: \"6c2d3561-a054-43b8-96a8-c230e061b808\") "
Sep 10 14:41:25.085449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085215    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:25.085449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c2d3561-a054-43b8-96a8-c230e061b808-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:25.085570 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085431    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:25.085570 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085499    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:25.085809 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085751    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:25.085809 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085783    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.085809 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085804    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.086040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085818    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2d3561-a054-43b8-96a8-c230e061b808-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.086040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.085832    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.087200 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.087179    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-kube-api-access-w6ntx" (OuterVolumeSpecName: "kube-api-access-w6ntx") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "kube-api-access-w6ntx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:25.087624 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.087608    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:25.087758 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.087616    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:25.087821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.087756    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c2d3561-a054-43b8-96a8-c230e061b808-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c2d3561-a054-43b8-96a8-c230e061b808" (UID: "6c2d3561-a054-43b8-96a8-c230e061b808"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:41:25.187500 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.187404    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6ntx\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-kube-api-access-w6ntx\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.187500 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.187451    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.187500 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.187465    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2d3561-a054-43b8-96a8-c230e061b808-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.187500 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.187477    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2d3561-a054-43b8-96a8-c230e061b808-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.187500 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.187489    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2d3561-a054-43b8-96a8-c230e061b808-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:25.508685 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.508592    2561 generic.go:356] "Generic (PLEG): container finished" podID="6c2d3561-a054-43b8-96a8-c230e061b808" containerID="bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9" exitCode=0
Sep 10 14:41:25.508685 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.508650    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"
Sep 10 14:41:25.508685 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.508672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" event={"ID":"6c2d3561-a054-43b8-96a8-c230e061b808","Type":"ContainerDied","Data":"bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9"}
Sep 10 14:41:25.509122 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.508753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t" event={"ID":"6c2d3561-a054-43b8-96a8-c230e061b808","Type":"ContainerDied","Data":"30dd3e591c7bff4421d08a8aa7f8b977cc044e207e8f842e51d117046e7696f7"}
Sep 10 14:41:25.509122 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.508785    2561 scope.go:117] "RemoveContainer" containerID="bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9"
Sep 10 14:41:25.519375 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.519349    2561 scope.go:117] "RemoveContainer" containerID="6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85"
Sep 10 14:41:25.530681 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.530650    2561 scope.go:117] "RemoveContainer" containerID="bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9"
Sep 10 14:41:25.531158 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:41:25.531124    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9\": container with ID starting with bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9 not found: ID does not exist" containerID="bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9"
Sep 10 14:41:25.531263 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.531172    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9"} err="failed to get container status \"bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9\": rpc error: code = NotFound desc = could not find container \"bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9\": container with ID starting with bdae12527a86b266b3369635bd80502576971d69a62adba5d222c4cec9e38aa9 not found: ID does not exist"
Sep 10 14:41:25.531263 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.531197    2561 scope.go:117] "RemoveContainer" containerID="6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85"
Sep 10 14:41:25.531543 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:41:25.531517    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85\": container with ID starting with 6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85 not found: ID does not exist" containerID="6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85"
Sep 10 14:41:25.531610 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.531552    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85"} err="failed to get container status \"6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85\": rpc error: code = NotFound desc = could not find container \"6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85\": container with ID starting with 6abd31a4a79bc753bb263a459f4afc61eaf168619b3e645952659acdef7e8a85 not found: ID does not exist"
Sep 10 14:41:25.533155 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.533133    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"]
Sep 10 14:41:25.535555 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.535535    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c2ce1a1c-openshift-default-7b47657666-ksx9t"]
Sep 10 14:41:25.995465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:25.995428    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" path="/var/lib/kubelet/pods/6c2d3561-a054-43b8-96a8-c230e061b808/volumes"
Sep 10 14:41:27.523191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:27.523159    2561 generic.go:356] "Generic (PLEG): container finished" podID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerID="6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b" exitCode=0
Sep 10 14:41:27.523626 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:27.523200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" event={"ID":"7c4dc1d0-b220-44ad-9c01-306bb7320657","Type":"ContainerDied","Data":"6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b"}
Sep 10 14:41:27.523676 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:27.523637    2561 scope.go:117] "RemoveContainer" containerID="6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b"
Sep 10 14:41:27.524930 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:27.524901    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:27.525006 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:27.524974    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:27.525044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:27.525007    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:28.535327 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:28.535221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" event={"ID":"7c4dc1d0-b220-44ad-9c01-306bb7320657","Type":"ContainerStarted","Data":"8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253"}
Sep 10 14:41:28.989065 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:28.989033    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:28.990202 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:28.990179    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:41:28.990261 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:28.990230    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 14:41:29.988785 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:29.988741    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:41:29.989254 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:29.988810    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 14:41:30.989351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:30.989317    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:41:30.989748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:30.989383    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 14:41:31.989358 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:31.989314    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:41:31.989851 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:31.989369    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 14:41:32.213735 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.213686    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"]
Sep 10 14:41:32.214246 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.214228    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy"
Sep 10 14:41:32.214341 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.214249    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy"
Sep 10 14:41:32.214341 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.214274    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy"
Sep 10 14:41:32.214341 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.214283    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy"
Sep 10 14:41:32.214498 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.214417    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy"
Sep 10 14:41:32.218735 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.218714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.224726 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.223119    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5b0323\"/\"openshift-service-ca.crt\""
Sep 10 14:41:32.224726 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.223346    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5b0323\"/\"kube-root-ca.crt\""
Sep 10 14:41:32.224726 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.223552    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b0323\"/\"default-dockercfg-r4d7f\""
Sep 10 14:41:32.224726 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.223786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b0323\"/\"simulator-w4-5b0323-kserve-self-signed-certs\""
Sep 10 14:41:32.232728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.228902    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"]
Sep 10 14:41:32.270857 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.270825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-model-cache\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.271028 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.270891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tmp-dir\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.271028 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.270947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tls-certs\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.271028 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.270998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8t42\" (UniqueName: \"kubernetes.io/projected/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-kube-api-access-p8t42\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.271028 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.271014    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-home\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.271222 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.271126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-dshm\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.278516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.278489    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:32.372033 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.371987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-dshm\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-model-cache\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372137    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tmp-dir\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tls-certs\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372416 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8t42\" (UniqueName: \"kubernetes.io/projected/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-kube-api-access-p8t42\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372416 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-home\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372523 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-model-cache\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372581 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372536    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tmp-dir\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.372854 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.372837    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-home\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.374226 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.374205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-dshm\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.374542 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.374525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tls-certs\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.380092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.380072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8t42\" (UniqueName: \"kubernetes.io/projected/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-kube-api-access-p8t42\") pod \"simulator-w4-5b0323-kserve-578fd7df8b-v4pfv\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") " pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.556553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.556454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:32.845095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.833423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"]
Sep 10 14:41:32.988694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.988656    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:41:32.988694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:32.988732    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 14:41:33.572445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:33.572404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv" event={"ID":"5b35aea7-3aa6-475d-8c18-966a3a2c0d49","Type":"ContainerStarted","Data":"3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945"}
Sep 10 14:41:33.572445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:33.572449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv" event={"ID":"5b35aea7-3aa6-475d-8c18-966a3a2c0d49","Type":"ContainerStarted","Data":"7b0c472d4dbb4d11a67348b16695c4e9ec8e3509f3a91456cee633693f2e3593"}
Sep 10 14:41:33.590508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:33.590450    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv" podStartSLOduration=1.590433769 podStartE2EDuration="1.590433769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:33.588630565 +0000 UTC m=+808.052997121" watchObservedRunningTime="2026-09-10 14:41:33.590433769 +0000 UTC m=+808.054800291"
Sep 10 14:41:33.989085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:33.989039    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:41:33.989265 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:33.989103    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 14:41:34.993383 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:34.993348    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:34.994331 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:34.994311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:41:42.556587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:42.556534    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:42.556587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:42.556604    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:42.569611 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:42.569575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:42.659008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:42.658974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:41:47.670025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.669985    2561 generic.go:356] "Generic (PLEG): container finished" podID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerID="612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8" exitCode=0
Sep 10 14:41:47.670503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.670047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" event={"ID":"ab1cf474-778a-49ae-8327-ad3be40cc6c0","Type":"ContainerDied","Data":"612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8"}
Sep 10 14:41:47.670503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.670497    2561 scope.go:117] "RemoveContainer" containerID="612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8"
Sep 10 14:41:47.671751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.671716    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:47.671859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.671829    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:47.671929 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.671880    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:47.979807 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.979719    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"]
Sep 10 14:41:47.980639 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.980616    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c2d3561-a054-43b8-96a8-c230e061b808" containerName="istio-proxy"
Sep 10 14:41:47.984046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.984026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"
Sep 10 14:41:47.986878 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.986620    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:41:47.999061 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:47.999030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"]
Sep 10 14:41:48.058296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.058248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43d0893-56c7-40f2-a138-743fa8f6ac00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb\" (UID: \"a43d0893-56c7-40f2-a138-743fa8f6ac00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"
Sep 10 14:41:48.159612 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.159566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43d0893-56c7-40f2-a138-743fa8f6ac00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb\" (UID: \"a43d0893-56c7-40f2-a138-743fa8f6ac00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"
Sep 10 14:41:48.160589 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.160558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43d0893-56c7-40f2-a138-743fa8f6ac00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb\" (UID: \"a43d0893-56c7-40f2-a138-743fa8f6ac00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"
Sep 10 14:41:48.299136 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.299047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"
Sep 10 14:41:48.600972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.600942    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"]
Sep 10 14:41:48.602695 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:41:48.602665    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43d0893_56c7_40f2_a138_743fa8f6ac00.slice/crio-c7a9f5fe880e28dda14a716c378e19a0d6bb4cf6bd8e8e748303eed246ec9ec5 WatchSource:0}: Error finding container c7a9f5fe880e28dda14a716c378e19a0d6bb4cf6bd8e8e748303eed246ec9ec5: Status 404 returned error can't find the container with id c7a9f5fe880e28dda14a716c378e19a0d6bb4cf6bd8e8e748303eed246ec9ec5
Sep 10 14:41:48.678206 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.678164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" event={"ID":"ab1cf474-778a-49ae-8327-ad3be40cc6c0","Type":"ContainerStarted","Data":"514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714"}
Sep 10 14:41:48.679525 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.679498    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb" event={"ID":"a43d0893-56c7-40f2-a138-743fa8f6ac00","Type":"ContainerStarted","Data":"c7a9f5fe880e28dda14a716c378e19a0d6bb4cf6bd8e8e748303eed246ec9ec5"}
Sep 10 14:41:48.981442 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.981407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:48.982293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.982267    2561 patch_prober.go:28] interesting pod/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:41:48.982396 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:48.982324    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 14:41:49.689111 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:49.689071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb" event={"ID":"a43d0893-56c7-40f2-a138-743fa8f6ac00","Type":"ContainerStarted","Data":"aaeb7b93d701924c2bb50022c459f3839ba2ae9a8ea7647592662e37364ea4bb"}
Sep 10 14:41:49.706074 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:49.706021    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb" podStartSLOduration=2.706005068 podStartE2EDuration="2.706005068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:49.70352358 +0000 UTC m=+824.167890101" watchObservedRunningTime="2026-09-10 14:41:49.706005068 +0000 UTC m=+824.170371590"
Sep 10 14:41:49.981492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:49.981391    2561 patch_prober.go:28] interesting pod/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:41:49.981492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:49.981459    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 14:41:50.695997 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:50.695956    2561 generic.go:356] "Generic (PLEG): container finished" podID="a43d0893-56c7-40f2-a138-743fa8f6ac00" containerID="aaeb7b93d701924c2bb50022c459f3839ba2ae9a8ea7647592662e37364ea4bb" exitCode=0
Sep 10 14:41:50.696470 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:50.696038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb" event={"ID":"a43d0893-56c7-40f2-a138-743fa8f6ac00","Type":"ContainerDied","Data":"aaeb7b93d701924c2bb50022c459f3839ba2ae9a8ea7647592662e37364ea4bb"}
Sep 10 14:41:50.981773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:50.981677    2561 patch_prober.go:28] interesting pod/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:41:50.981773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:50.981751    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 14:41:51.900906 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:51.900877    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"
Sep 10 14:41:51.982485 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:51.982399    2561 patch_prober.go:28] interesting pod/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:41:51.982485 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:51.982454    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 14:41:52.002090 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.002062    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43d0893-56c7-40f2-a138-743fa8f6ac00-maas-api-service-ca\") pod \"a43d0893-56c7-40f2-a138-743fa8f6ac00\" (UID: \"a43d0893-56c7-40f2-a138-743fa8f6ac00\") "
Sep 10 14:41:52.002468 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.002441    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a43d0893-56c7-40f2-a138-743fa8f6ac00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a43d0893-56c7-40f2-a138-743fa8f6ac00" (UID: "a43d0893-56c7-40f2-a138-743fa8f6ac00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:52.103947 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.103900    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a43d0893-56c7-40f2-a138-743fa8f6ac00-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:41:52.717424 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.717387    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"
Sep 10 14:41:52.717613 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.717423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb" event={"ID":"a43d0893-56c7-40f2-a138-743fa8f6ac00","Type":"ContainerDied","Data":"c7a9f5fe880e28dda14a716c378e19a0d6bb4cf6bd8e8e748303eed246ec9ec5"}
Sep 10 14:41:52.717613 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.717502    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7a9f5fe880e28dda14a716c378e19a0d6bb4cf6bd8e8e748303eed246ec9ec5"
Sep 10 14:41:52.981668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.981575    2561 patch_prober.go:28] interesting pod/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:41:52.981668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:52.981633    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 14:41:53.485050 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:53.485010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:53.985479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:53.985448    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:53.986606 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:53.986588    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:41:54.091074 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:54.091039    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"]
Sep 10 14:41:54.093640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:54.093611    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b72890-sq6wb"]
Sep 10 14:41:54.231974 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:54.231936    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"]
Sep 10 14:41:54.732150 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:54.732114    2561 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" secret="" err="secret \"e2e-migrate-42b72890-gw-openshift-default-dockercfg-j2c6k\" not found"
Sep 10 14:41:55.015732 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.015636    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"]
Sep 10 14:41:55.016141 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.016125    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43d0893-56c7-40f2-a138-743fa8f6ac00" containerName="revoke-keys"
Sep 10 14:41:55.016141 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.016142    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43d0893-56c7-40f2-a138-743fa8f6ac00" containerName="revoke-keys"
Sep 10 14:41:55.016252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.016243    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a43d0893-56c7-40f2-a138-743fa8f6ac00" containerName="revoke-keys"
Sep 10 14:41:55.019602 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.019583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.022509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.022481    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7b4382a5-openshift-default-dockercfg-58ndb\""
Sep 10 14:41:55.040139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.040106    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"]
Sep 10 14:41:55.151723 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.151664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-certs\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.151993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.151759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istiod-ca-cert\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.151993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.151803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-podinfo\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.151993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.151833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-socket\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.152169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.151997    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhzkz\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-kube-api-access-lhzkz\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.152228 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.152194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-data\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.152228 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.152218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-token\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.152346 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.152317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-credential-socket\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.153092 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.153059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-envoy\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.253821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.253784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-data\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.253821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.253820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-token\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.253889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-credential-socket\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.253983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-envoy\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-certs\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254179 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istiod-ca-cert\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254179 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-podinfo\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254179 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-socket\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254247    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-data\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhzkz\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-kube-api-access-lhzkz\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254320    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-credential-socket\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-certs\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.254744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254486    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-socket\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.255001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.254879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istiod-ca-cert\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.256335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.256310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-envoy\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.256519 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.256501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-podinfo\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.263111 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.263078    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhzkz\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-kube-api-access-lhzkz\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.263266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.263127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-token\") pod \"e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") " pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.331584 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.331487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:55.614146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.614118    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"]
Sep 10 14:41:55.615940 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:41:55.615910    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721f38d3_1807_48ac_abdc_f2ab1c337a4d.slice/crio-026f1d0d8d883717db68ae395b4b3b672d37b14b8eadad6497307a50dcf05fa4 WatchSource:0}: Error finding container 026f1d0d8d883717db68ae395b4b3b672d37b14b8eadad6497307a50dcf05fa4: Status 404 returned error can't find the container with id 026f1d0d8d883717db68ae395b4b3b672d37b14b8eadad6497307a50dcf05fa4
Sep 10 14:41:55.618415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.618378    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:55.618501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.618447    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:55.618501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.618477    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:41:55.742248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.742192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" event={"ID":"721f38d3-1807-48ac-abdc-f2ab1c337a4d","Type":"ContainerStarted","Data":"d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024"}
Sep 10 14:41:55.742481 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.742279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" event={"ID":"721f38d3-1807-48ac-abdc-f2ab1c337a4d","Type":"ContainerStarted","Data":"026f1d0d8d883717db68ae395b4b3b672d37b14b8eadad6497307a50dcf05fa4"}
Sep 10 14:41:55.742481 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.742447    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy" containerID="cri-o://514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714" gracePeriod=30
Sep 10 14:41:55.783750 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.783677    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" podStartSLOduration=1.783660802 podStartE2EDuration="1.783660802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:55.780844399 +0000 UTC m=+830.245210920" watchObservedRunningTime="2026-09-10 14:41:55.783660802 +0000 UTC m=+830.248027324"
Sep 10 14:41:55.994889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:55.994856    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a43d0893-56c7-40f2-a138-743fa8f6ac00" path="/var/lib/kubelet/pods/a43d0893-56c7-40f2-a138-743fa8f6ac00/volumes"
Sep 10 14:41:56.332257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:56.332161    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:56.338093 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:56.338062    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:56.748876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:56.748844    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:56.749935 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:56.749913    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:41:58.921605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:58.921567    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"]
Sep 10 14:41:58.926725 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:58.926684    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:58.929963 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:58.929324    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-7b4382a5-dockercfg-5qz82\""
Sep 10 14:41:58.929963 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:58.929342    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-7b4382a5\""
Sep 10 14:41:58.934352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:58.934326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"]
Sep 10 14:41:59.006472 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.006430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzl7j\" (UniqueName: \"kubernetes.io/projected/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-kube-api-access-gzl7j\") pod \"payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") " pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.006670 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.006549    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-plugins-config-volume\") pod \"payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") " pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.108289 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.108247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzl7j\" (UniqueName: \"kubernetes.io/projected/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-kube-api-access-gzl7j\") pod \"payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") " pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.108516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.108378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-plugins-config-volume\") pod \"payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") " pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.109253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.109228    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-plugins-config-volume\") pod \"payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") " pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.116927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.116896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzl7j\" (UniqueName: \"kubernetes.io/projected/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-kube-api-access-gzl7j\") pod \"payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") " pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.242096 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.242002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.515664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.515633    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"]
Sep 10 14:41:59.517103 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:41:59.517073    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf392e2f_6ae4_4fec_a9c7_e275bfe65e25.slice/crio-e7be500a9cd0f868ed5c70c2b4d64d1d5e74403e7e9a7364b927843d2d2ed95b WatchSource:0}: Error finding container e7be500a9cd0f868ed5c70c2b4d64d1d5e74403e7e9a7364b927843d2d2ed95b: Status 404 returned error can't find the container with id e7be500a9cd0f868ed5c70c2b4d64d1d5e74403e7e9a7364b927843d2d2ed95b
Sep 10 14:41:59.767692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.767590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx" event={"ID":"af392e2f-6ae4-4fec-a9c7-e275bfe65e25","Type":"ContainerStarted","Data":"9f19ac7c4bbff2cffd6eb19cb678edcd2e4715a987bb59e634588ed471496063"}
Sep 10 14:41:59.767692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.767648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx" event={"ID":"af392e2f-6ae4-4fec-a9c7-e275bfe65e25","Type":"ContainerStarted","Data":"e7be500a9cd0f868ed5c70c2b4d64d1d5e74403e7e9a7364b927843d2d2ed95b"}
Sep 10 14:41:59.767961 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.767699    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:41:59.783951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:41:59.783891    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx" podStartSLOduration=1.783872071 podStartE2EDuration="1.783872071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:59.782805979 +0000 UTC m=+834.247172503" watchObservedRunningTime="2026-09-10 14:41:59.783872071 +0000 UTC m=+834.248238593"
Sep 10 14:42:01.030130 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.030100    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:42:01.134407 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-token\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134619 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134443    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-podinfo\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134619 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134472    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-socket\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134619 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134502    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-data\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134619 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134550    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-certs\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134872 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134634    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdl4z\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-kube-api-access-xdl4z\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134872 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134677    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-credential-socket\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134872 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134728    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istiod-ca-cert\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.134872 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134812    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:01.134872 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-envoy\") pod \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\" (UID: \"ab1cf474-778a-49ae-8327-ad3be40cc6c0\") "
Sep 10 14:42:01.135123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134940    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:01.135123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134942    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:01.135123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.134957    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:01.135123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.135109    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:01.135605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.135509    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.135605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.135533    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.135605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.135549    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.135605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.135561    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.135605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.135573    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.137124 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.137099    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:01.137264 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.137240    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:42:01.137320 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.137266    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:01.137320 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.137288    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-kube-api-access-xdl4z" (OuterVolumeSpecName: "kube-api-access-xdl4z") pod "ab1cf474-778a-49ae-8327-ad3be40cc6c0" (UID: "ab1cf474-778a-49ae-8327-ad3be40cc6c0"). InnerVolumeSpecName "kube-api-access-xdl4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:01.237436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.237387    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdl4z\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-kube-api-access-xdl4z\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.237436 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.237435    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.237651 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.237449    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.237651 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.237462    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1cf474-778a-49ae-8327-ad3be40cc6c0-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:01.782274 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.782231    2561 generic.go:356] "Generic (PLEG): container finished" podID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerID="514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714" exitCode=0
Sep 10 14:42:01.782505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.782286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"
Sep 10 14:42:01.782505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.782315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" event={"ID":"ab1cf474-778a-49ae-8327-ad3be40cc6c0","Type":"ContainerDied","Data":"514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714"}
Sep 10 14:42:01.782505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.782379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh" event={"ID":"ab1cf474-778a-49ae-8327-ad3be40cc6c0","Type":"ContainerDied","Data":"f556f0b5628e1b0f1681d206d5b81f5b8549085ee46a27641fd4f2d6b0bb0be4"}
Sep 10 14:42:01.782505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.782414    2561 scope.go:117] "RemoveContainer" containerID="514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714"
Sep 10 14:42:01.793390 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.793370    2561 scope.go:117] "RemoveContainer" containerID="612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8"
Sep 10 14:42:01.805618 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.805582    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"]
Sep 10 14:42:01.806313 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.806292    2561 scope.go:117] "RemoveContainer" containerID="514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714"
Sep 10 14:42:01.806743 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:42:01.806687    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714\": container with ID starting with 514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714 not found: ID does not exist" containerID="514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714"
Sep 10 14:42:01.806796 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.806757    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714"} err="failed to get container status \"514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714\": rpc error: code = NotFound desc = could not find container \"514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714\": container with ID starting with 514fb60201d07d7e838b9347188175a37b3fc866bb83db0ef602599930f2b714 not found: ID does not exist"
Sep 10 14:42:01.806796 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.806777    2561 scope.go:117] "RemoveContainer" containerID="612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8"
Sep 10 14:42:01.807069 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:42:01.807050    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8\": container with ID starting with 612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8 not found: ID does not exist" containerID="612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8"
Sep 10 14:42:01.807111 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.807074    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8"} err="failed to get container status \"612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8\": rpc error: code = NotFound desc = could not find container \"612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8\": container with ID starting with 612068cea949be5d35742e704026db3f191bb03da6f700d825a7f9593fe05ca8 not found: ID does not exist"
Sep 10 14:42:01.811022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.810987    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-42b72890-gw-openshift-default-5bcb556456-tz2rh"]
Sep 10 14:42:01.994674 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:01.994629    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" path="/var/lib/kubelet/pods/ab1cf474-778a-49ae-8327-ad3be40cc6c0/volumes"
Sep 10 14:42:10.776126 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:10.776091    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:42:17.898973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:17.898939    2561 generic.go:356] "Generic (PLEG): container finished" podID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerID="d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024" exitCode=0
Sep 10 14:42:17.899427 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:17.899015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" event={"ID":"721f38d3-1807-48ac-abdc-f2ab1c337a4d","Type":"ContainerDied","Data":"d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024"}
Sep 10 14:42:17.899609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:17.899590    2561 scope.go:117] "RemoveContainer" containerID="d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024"
Sep 10 14:42:17.900921 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:17.900888    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:17.900995 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:17.900981    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:17.901044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:17.901029    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:18.907347 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:18.907303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" event={"ID":"721f38d3-1807-48ac-abdc-f2ab1c337a4d","Type":"ContainerStarted","Data":"e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3"}
Sep 10 14:42:19.332101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:19.331994    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:42:19.332560 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:19.332527    2561 patch_prober.go:28] interesting pod/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 14:42:19.332827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:19.332794    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 14:42:20.332790 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:20.332738    2561 patch_prober.go:28] interesting pod/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 14:42:20.333299 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:20.332832    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 14:42:21.332399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:21.332351    2561 patch_prober.go:28] interesting pod/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 14:42:21.332691 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:21.332659    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 14:42:22.332233 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.332182    2561 patch_prober.go:28] interesting pod/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 14:42:22.332773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.332259    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 14:42:22.994466 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.994421    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"]
Sep 10 14:42:22.995069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.995047    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy"
Sep 10 14:42:22.995069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.995068    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy"
Sep 10 14:42:22.995252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.995086    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy"
Sep 10 14:42:22.995252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.995094    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy"
Sep 10 14:42:22.995252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.995213    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy"
Sep 10 14:42:22.995252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.995230    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1cf474-778a-49ae-8327-ad3be40cc6c0" containerName="istio-proxy"
Sep 10 14:42:22.997610 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:22.997587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"
Sep 10 14:42:23.000082 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.000055    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:42:23.005203 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.005176    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"]
Sep 10 14:42:23.101297 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.101261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2917f54c-52e0-4e46-b34b-5e6bb4153cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8\" (UID: \"2917f54c-52e0-4e46-b34b-5e6bb4153cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"
Sep 10 14:42:23.202203 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.202164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2917f54c-52e0-4e46-b34b-5e6bb4153cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8\" (UID: \"2917f54c-52e0-4e46-b34b-5e6bb4153cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"
Sep 10 14:42:23.202926 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.202906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2917f54c-52e0-4e46-b34b-5e6bb4153cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8\" (UID: \"2917f54c-52e0-4e46-b34b-5e6bb4153cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"
Sep 10 14:42:23.311077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.310995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"
Sep 10 14:42:23.332655 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.332609    2561 patch_prober.go:28] interesting pod/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 14:42:23.333132 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.332693    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 14:42:23.603727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.603686    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"]
Sep 10 14:42:23.606112 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:42:23.606078    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2917f54c_52e0_4e46_b34b_5e6bb4153cf7.slice/crio-efbecb0434ea480674ef3a23df2b60339ef0c69acf69216ed9d5cc0bcc1a6460 WatchSource:0}: Error finding container efbecb0434ea480674ef3a23df2b60339ef0c69acf69216ed9d5cc0bcc1a6460: Status 404 returned error can't find the container with id efbecb0434ea480674ef3a23df2b60339ef0c69acf69216ed9d5cc0bcc1a6460
Sep 10 14:42:23.947770 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:23.947737    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8" event={"ID":"2917f54c-52e0-4e46-b34b-5e6bb4153cf7","Type":"ContainerStarted","Data":"efbecb0434ea480674ef3a23df2b60339ef0c69acf69216ed9d5cc0bcc1a6460"}
Sep 10 14:42:24.336986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:24.336900    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:42:24.337363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:24.337194    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:42:24.337958 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:24.337943    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:42:24.955419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:24.955381    2561 generic.go:356] "Generic (PLEG): container finished" podID="2917f54c-52e0-4e46-b34b-5e6bb4153cf7" containerID="f96fc0cfe8c61cc5e29404dd9f2085c6527da8b29be30372f0f572ac920edaea" exitCode=0
Sep 10 14:42:24.955632 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:24.955468    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8" event={"ID":"2917f54c-52e0-4e46-b34b-5e6bb4153cf7","Type":"ContainerDied","Data":"f96fc0cfe8c61cc5e29404dd9f2085c6527da8b29be30372f0f572ac920edaea"}
Sep 10 14:42:26.112410 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:26.112381    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"
Sep 10 14:42:26.240848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:26.240750    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2917f54c-52e0-4e46-b34b-5e6bb4153cf7-maas-api-service-ca\") pod \"2917f54c-52e0-4e46-b34b-5e6bb4153cf7\" (UID: \"2917f54c-52e0-4e46-b34b-5e6bb4153cf7\") "
Sep 10 14:42:26.241210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:26.241182    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2917f54c-52e0-4e46-b34b-5e6bb4153cf7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2917f54c-52e0-4e46-b34b-5e6bb4153cf7" (UID: "2917f54c-52e0-4e46-b34b-5e6bb4153cf7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:26.342606 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:26.342558    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2917f54c-52e0-4e46-b34b-5e6bb4153cf7-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:26.969547 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:26.969509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8" event={"ID":"2917f54c-52e0-4e46-b34b-5e6bb4153cf7","Type":"ContainerDied","Data":"efbecb0434ea480674ef3a23df2b60339ef0c69acf69216ed9d5cc0bcc1a6460"}
Sep 10 14:42:26.969754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:26.969549    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"
Sep 10 14:42:26.969754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:26.969562    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efbecb0434ea480674ef3a23df2b60339ef0c69acf69216ed9d5cc0bcc1a6460"
Sep 10 14:42:28.820962 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:28.820913    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"]
Sep 10 14:42:28.821785 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:28.821744    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx" podUID="af392e2f-6ae4-4fec-a9c7-e275bfe65e25" containerName="payload-processing" containerID="cri-o://9f19ac7c4bbff2cffd6eb19cb678edcd2e4715a987bb59e634588ed471496063" gracePeriod=30
Sep 10 14:42:28.983380 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:28.983348    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"]
Sep 10 14:42:28.984178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:28.984080    2561 generic.go:356] "Generic (PLEG): container finished" podID="af392e2f-6ae4-4fec-a9c7-e275bfe65e25" containerID="9f19ac7c4bbff2cffd6eb19cb678edcd2e4715a987bb59e634588ed471496063" exitCode=0
Sep 10 14:42:28.984178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:28.984129    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx" event={"ID":"af392e2f-6ae4-4fec-a9c7-e275bfe65e25","Type":"ContainerDied","Data":"9f19ac7c4bbff2cffd6eb19cb678edcd2e4715a987bb59e634588ed471496063"}
Sep 10 14:42:28.986176 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:28.986154    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7b4382a5-8qjx8"]
Sep 10 14:42:29.135055 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.135021    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:42:29.280752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.280689    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-plugins-config-volume\") pod \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") "
Sep 10 14:42:29.280928 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.280863    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzl7j\" (UniqueName: \"kubernetes.io/projected/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-kube-api-access-gzl7j\") pod \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\" (UID: \"af392e2f-6ae4-4fec-a9c7-e275bfe65e25\") "
Sep 10 14:42:29.281076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.281052    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af392e2f-6ae4-4fec-a9c7-e275bfe65e25" (UID: "af392e2f-6ae4-4fec-a9c7-e275bfe65e25"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:29.281163 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.281150    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:29.282938 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.282907    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-kube-api-access-gzl7j" (OuterVolumeSpecName: "kube-api-access-gzl7j") pod "af392e2f-6ae4-4fec-a9c7-e275bfe65e25" (UID: "af392e2f-6ae4-4fec-a9c7-e275bfe65e25"). InnerVolumeSpecName "kube-api-access-gzl7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:29.382752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.382617    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzl7j\" (UniqueName: \"kubernetes.io/projected/af392e2f-6ae4-4fec-a9c7-e275bfe65e25-kube-api-access-gzl7j\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:29.992345 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.992314    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"
Sep 10 14:42:29.999978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:29.999922    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2917f54c-52e0-4e46-b34b-5e6bb4153cf7" path="/var/lib/kubelet/pods/2917f54c-52e0-4e46-b34b-5e6bb4153cf7/volumes"
Sep 10 14:42:30.000902 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.000874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx" event={"ID":"af392e2f-6ae4-4fec-a9c7-e275bfe65e25","Type":"ContainerDied","Data":"e7be500a9cd0f868ed5c70c2b4d64d1d5e74403e7e9a7364b927843d2d2ed95b"}
Sep 10 14:42:30.001145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.001128    2561 scope.go:117] "RemoveContainer" containerID="9f19ac7c4bbff2cffd6eb19cb678edcd2e4715a987bb59e634588ed471496063"
Sep 10 14:42:30.023060 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.023022    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"]
Sep 10 14:42:30.026572 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.026538    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-7b4382a5-8dbd5479-pj5zx"]
Sep 10 14:42:30.103358 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.103320    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"]
Sep 10 14:42:30.103633 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.103583    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy" containerID="cri-o://e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3" gracePeriod=30
Sep 10 14:42:30.814529 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.814496    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"]
Sep 10 14:42:30.815035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.815018    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2917f54c-52e0-4e46-b34b-5e6bb4153cf7" containerName="revoke-keys"
Sep 10 14:42:30.815035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.815036    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2917f54c-52e0-4e46-b34b-5e6bb4153cf7" containerName="revoke-keys"
Sep 10 14:42:30.815126 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.815049    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af392e2f-6ae4-4fec-a9c7-e275bfe65e25" containerName="payload-processing"
Sep 10 14:42:30.815126 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.815055    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="af392e2f-6ae4-4fec-a9c7-e275bfe65e25" containerName="payload-processing"
Sep 10 14:42:30.815188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.815140    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2917f54c-52e0-4e46-b34b-5e6bb4153cf7" containerName="revoke-keys"
Sep 10 14:42:30.815188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.815150    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="af392e2f-6ae4-4fec-a9c7-e275bfe65e25" containerName="payload-processing"
Sep 10 14:42:30.819549 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.819524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:30.821996 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.821969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-26c48a75-openshift-default-dockercfg-tdc9r\""
Sep 10 14:42:30.831742 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:30.831572    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"]
Sep 10 14:42:31.003406 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-certs\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-podinfo\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zfdc\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-kube-api-access-8zfdc\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-data\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-token\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-socket\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18cbce08-2186-4b11-a9b5-b7211e61e41f-istiod-ca-cert\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-envoy\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.003869 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.003719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-credential-socket\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.104801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.104697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-certs\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.104801 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.104794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-podinfo\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.104844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zfdc\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-kube-api-access-8zfdc\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.104872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-data\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.104896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-token\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.104916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-socket\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.104959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18cbce08-2186-4b11-a9b5-b7211e61e41f-istiod-ca-cert\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.105007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-envoy\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105326 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.105043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-credential-socket\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105326 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.105068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-certs\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105326 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.105139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-data\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105488 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.105325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-socket\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105488 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.105357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-credential-socket\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.105786 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.105763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18cbce08-2186-4b11-a9b5-b7211e61e41f-istiod-ca-cert\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.107270 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.107252    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-envoy\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.107590 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.107570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-podinfo\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.115795 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.115767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-token\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.115991 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.115971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zfdc\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-kube-api-access-8zfdc\") pod \"e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") " pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.133836 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.133799    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:31.419323 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.419295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"]
Sep 10 14:42:31.421050 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:42:31.421017    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cbce08_2186_4b11_a9b5_b7211e61e41f.slice/crio-4dbf080f5c6fa7414e807850c47226b37cf63d88d26a885518438833d2811b85 WatchSource:0}: Error finding container 4dbf080f5c6fa7414e807850c47226b37cf63d88d26a885518438833d2811b85: Status 404 returned error can't find the container with id 4dbf080f5c6fa7414e807850c47226b37cf63d88d26a885518438833d2811b85
Sep 10 14:42:31.423827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.423781    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:31.423919 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.423873    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:31.423968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.423915    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:31.994967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:31.994932    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af392e2f-6ae4-4fec-a9c7-e275bfe65e25" path="/var/lib/kubelet/pods/af392e2f-6ae4-4fec-a9c7-e275bfe65e25/volumes"
Sep 10 14:42:32.006680 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:32.006649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" event={"ID":"18cbce08-2186-4b11-a9b5-b7211e61e41f","Type":"ContainerStarted","Data":"ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd"}
Sep 10 14:42:32.007055 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:32.006717    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" event={"ID":"18cbce08-2186-4b11-a9b5-b7211e61e41f","Type":"ContainerStarted","Data":"4dbf080f5c6fa7414e807850c47226b37cf63d88d26a885518438833d2811b85"}
Sep 10 14:42:32.134388 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:32.134355    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:32.158303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:32.158262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:32.178027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:32.177975    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" podStartSLOduration=2.177959587 podStartE2EDuration="2.177959587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:42:32.026110825 +0000 UTC m=+866.490477349" watchObservedRunningTime="2026-09-10 14:42:32.177959587 +0000 UTC m=+866.642326108"
Sep 10 14:42:33.012860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:33.012831    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:33.013830 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:33.013810    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:35.389108 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.389029    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:42:35.540548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.536821    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"]
Sep 10 14:42:35.540548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.537595    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy"
Sep 10 14:42:35.540548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.537614    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy"
Sep 10 14:42:35.540548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.537627    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy"
Sep 10 14:42:35.540548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.537636    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy"
Sep 10 14:42:35.540548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.537766    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy"
Sep 10 14:42:35.540548 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.537779    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerName="istio-proxy"
Sep 10 14:42:35.541898 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.541857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:35.547595 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.546017    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"]
Sep 10 14:42:35.547595 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.546783    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-26c48a75\""
Sep 10 14:42:35.548250 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.548219    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-26c48a75-dockercfg-kkm8f\""
Sep 10 14:42:35.559296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559273    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhzkz\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-kube-api-access-lhzkz\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-socket\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559326    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-credential-socket\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559438 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559431    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-envoy\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559456    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-token\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559491    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istiod-ca-cert\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559566    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-certs\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559590    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-data\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559590    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:35.559660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559613    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-podinfo\") pod \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\" (UID: \"721f38d3-1807-48ac-abdc-f2ab1c337a4d\") "
Sep 10 14:42:35.559988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.559818    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:35.560324 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.560094    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:35.560324 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.560228    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-data" (OuterVolumeSpecName: "istio-data") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:35.561667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.561019    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.561667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.561045    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.561667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.561058    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.561667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.561059    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:35.561667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.561071    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.563814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.562675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:42:35.563814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.563296    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-token" (OuterVolumeSpecName: "istio-token") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:35.563814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.563504    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:35.564398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.564133    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-kube-api-access-lhzkz" (OuterVolumeSpecName: "kube-api-access-lhzkz") pod "721f38d3-1807-48ac-abdc-f2ab1c337a4d" (UID: "721f38d3-1807-48ac-abdc-f2ab1c337a4d"). InnerVolumeSpecName "kube-api-access-lhzkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:35.662031 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.661987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554b182c-e8ed-4fd4-8bd1-143782a225bd-plugins-config-volume\") pod \"payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") " pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:35.662251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.662180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6kck\" (UniqueName: \"kubernetes.io/projected/554b182c-e8ed-4fd4-8bd1-143782a225bd-kube-api-access-r6kck\") pod \"payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") " pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:35.662309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.662291    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhzkz\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-kube-api-access-lhzkz\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.662343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.662310    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.662343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.662323    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.662343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.662336    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.662439 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.662349    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f38d3-1807-48ac-abdc-f2ab1c337a4d-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:35.763033 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.762984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554b182c-e8ed-4fd4-8bd1-143782a225bd-plugins-config-volume\") pod \"payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") " pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:35.763203 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.763097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6kck\" (UniqueName: \"kubernetes.io/projected/554b182c-e8ed-4fd4-8bd1-143782a225bd-kube-api-access-r6kck\") pod \"payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") " pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:35.763752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.763694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554b182c-e8ed-4fd4-8bd1-143782a225bd-plugins-config-volume\") pod \"payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") " pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:35.774410 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.774378    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6kck\" (UniqueName: \"kubernetes.io/projected/554b182c-e8ed-4fd4-8bd1-143782a225bd-kube-api-access-r6kck\") pod \"payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") " pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:35.861833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:35.861797    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:36.034558 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.034513    2561 generic.go:356] "Generic (PLEG): container finished" podID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" containerID="e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3" exitCode=0
Sep 10 14:42:36.034754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.034568    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"
Sep 10 14:42:36.034754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.034597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" event={"ID":"721f38d3-1807-48ac-abdc-f2ab1c337a4d","Type":"ContainerDied","Data":"e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3"}
Sep 10 14:42:36.034754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.034652    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49" event={"ID":"721f38d3-1807-48ac-abdc-f2ab1c337a4d","Type":"ContainerDied","Data":"026f1d0d8d883717db68ae395b4b3b672d37b14b8eadad6497307a50dcf05fa4"}
Sep 10 14:42:36.034754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.034675    2561 scope.go:117] "RemoveContainer" containerID="e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3"
Sep 10 14:42:36.044747 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.044724    2561 scope.go:117] "RemoveContainer" containerID="d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024"
Sep 10 14:42:36.053660 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.053638    2561 scope.go:117] "RemoveContainer" containerID="e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3"
Sep 10 14:42:36.053966 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:42:36.053945    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3\": container with ID starting with e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3 not found: ID does not exist" containerID="e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3"
Sep 10 14:42:36.054013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.053976    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3"} err="failed to get container status \"e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3\": rpc error: code = NotFound desc = could not find container \"e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3\": container with ID starting with e5762eb5a27b137311f5c3a574a55637384c65b5ebd0b87e43b491a6e53144f3 not found: ID does not exist"
Sep 10 14:42:36.054013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.053995    2561 scope.go:117] "RemoveContainer" containerID="d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024"
Sep 10 14:42:36.054259 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:42:36.054241    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024\": container with ID starting with d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024 not found: ID does not exist" containerID="d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024"
Sep 10 14:42:36.054345 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.054266    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024"} err="failed to get container status \"d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024\": rpc error: code = NotFound desc = could not find container \"d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024\": container with ID starting with d2892fae824c427cc12c676e3151fe67c6bad335423e74c3b061c62c68492024 not found: ID does not exist"
Sep 10 14:42:36.058910 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.058885    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"]
Sep 10 14:42:36.063182 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.063154    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7b4382a5-openshift-default-5844c6f764-jpb49"]
Sep 10 14:42:36.145384 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:36.145352    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"]
Sep 10 14:42:36.153897 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:42:36.152804    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554b182c_e8ed_4fd4_8bd1_143782a225bd.slice/crio-70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897 WatchSource:0}: Error finding container 70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897: Status 404 returned error can't find the container with id 70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897
Sep 10 14:42:37.043199 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:37.043167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr" event={"ID":"554b182c-e8ed-4fd4-8bd1-143782a225bd","Type":"ContainerStarted","Data":"e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47"}
Sep 10 14:42:37.043597 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:37.043214    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr" event={"ID":"554b182c-e8ed-4fd4-8bd1-143782a225bd","Type":"ContainerStarted","Data":"70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897"}
Sep 10 14:42:37.043597 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:37.043357    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:37.059950 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:37.059899    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr" podStartSLOduration=2.059884279 podStartE2EDuration="2.059884279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:42:37.059263744 +0000 UTC m=+871.523630269" watchObservedRunningTime="2026-09-10 14:42:37.059884279 +0000 UTC m=+871.524250842"
Sep 10 14:42:37.996964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:37.996919    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="721f38d3-1807-48ac-abdc-f2ab1c337a4d" path="/var/lib/kubelet/pods/721f38d3-1807-48ac-abdc-f2ab1c337a4d/volumes"
Sep 10 14:42:48.051220 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:48.051183    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:42:55.382015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.381973    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"]
Sep 10 14:42:55.388022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.387984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"
Sep 10 14:42:55.390956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.390907    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:42:55.392862 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.392836    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"]
Sep 10 14:42:55.503831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.503792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed582c-3117-4795-b568-c91c9563823c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-22fb28-s2jgb\" (UID: \"f0ed582c-3117-4795-b568-c91c9563823c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"
Sep 10 14:42:55.605377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.605335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed582c-3117-4795-b568-c91c9563823c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-22fb28-s2jgb\" (UID: \"f0ed582c-3117-4795-b568-c91c9563823c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"
Sep 10 14:42:55.606030 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.606007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed582c-3117-4795-b568-c91c9563823c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-22fb28-s2jgb\" (UID: \"f0ed582c-3117-4795-b568-c91c9563823c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"
Sep 10 14:42:55.703580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.703540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"
Sep 10 14:42:55.997807 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:55.997778    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"]
Sep 10 14:42:56.000301 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:42:56.000263    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ed582c_3117_4795_b568_c91c9563823c.slice/crio-eadb4356ded9cf8f7bfea8535e336c9a4e2d69f3f39a5f31422d37f760d0e8f7 WatchSource:0}: Error finding container eadb4356ded9cf8f7bfea8535e336c9a4e2d69f3f39a5f31422d37f760d0e8f7: Status 404 returned error can't find the container with id eadb4356ded9cf8f7bfea8535e336c9a4e2d69f3f39a5f31422d37f760d0e8f7
Sep 10 14:42:56.177066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:56.177030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb" event={"ID":"f0ed582c-3117-4795-b568-c91c9563823c","Type":"ContainerStarted","Data":"eadb4356ded9cf8f7bfea8535e336c9a4e2d69f3f39a5f31422d37f760d0e8f7"}
Sep 10 14:42:57.184648 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.184611    2561 generic.go:356] "Generic (PLEG): container finished" podID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerID="ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd" exitCode=0
Sep 10 14:42:57.185089 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.184688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" event={"ID":"18cbce08-2186-4b11-a9b5-b7211e61e41f","Type":"ContainerDied","Data":"ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd"}
Sep 10 14:42:57.185270 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.185255    2561 scope.go:117] "RemoveContainer" containerID="ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd"
Sep 10 14:42:57.186309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.186285    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0ed582c-3117-4795-b568-c91c9563823c" containerID="1c72bfca6e08876f311404f72e41d4310cf4c15460d89cbcc55bc95e06b1a9b1" exitCode=0
Sep 10 14:42:57.186397 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.186376    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb" event={"ID":"f0ed582c-3117-4795-b568-c91c9563823c","Type":"ContainerDied","Data":"1c72bfca6e08876f311404f72e41d4310cf4c15460d89cbcc55bc95e06b1a9b1"}
Sep 10 14:42:57.186598 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.186570    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:57.186654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.186641    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:57.186690 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:57.186675    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:42:58.194550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.194465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" event={"ID":"18cbce08-2186-4b11-a9b5-b7211e61e41f","Type":"ContainerStarted","Data":"78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851"}
Sep 10 14:42:58.252384 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.252339    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"]
Sep 10 14:42:58.255288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.255260    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"
Sep 10 14:42:58.277684 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.277655    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"]
Sep 10 14:42:58.352543 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.352489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97aba85-3337-43b5-a16f-ad3303f17b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8\" (UID: \"e97aba85-3337-43b5-a16f-ad3303f17b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"
Sep 10 14:42:58.383812 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.383784    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"
Sep 10 14:42:58.456399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.456283    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed582c-3117-4795-b568-c91c9563823c-maas-api-service-ca\") pod \"f0ed582c-3117-4795-b568-c91c9563823c\" (UID: \"f0ed582c-3117-4795-b568-c91c9563823c\") "
Sep 10 14:42:58.456780 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.456691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97aba85-3337-43b5-a16f-ad3303f17b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8\" (UID: \"e97aba85-3337-43b5-a16f-ad3303f17b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"
Sep 10 14:42:58.456885 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.456795    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ed582c-3117-4795-b568-c91c9563823c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0ed582c-3117-4795-b568-c91c9563823c" (UID: "f0ed582c-3117-4795-b568-c91c9563823c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:58.457015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.456987    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ed582c-3117-4795-b568-c91c9563823c-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:42:58.457497 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.457470    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97aba85-3337-43b5-a16f-ad3303f17b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8\" (UID: \"e97aba85-3337-43b5-a16f-ad3303f17b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"
Sep 10 14:42:58.568560 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.568523    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"
Sep 10 14:42:58.874735 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:58.874683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"]
Sep 10 14:42:58.876936 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:42:58.876889    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97aba85_3337_43b5_a16f_ad3303f17b70.slice/crio-5bf3d05e1de4928ed01953cf9733fa3521b72844da79da8c5cafb99ec82a3031 WatchSource:0}: Error finding container 5bf3d05e1de4928ed01953cf9733fa3521b72844da79da8c5cafb99ec82a3031: Status 404 returned error can't find the container with id 5bf3d05e1de4928ed01953cf9733fa3521b72844da79da8c5cafb99ec82a3031
Sep 10 14:42:59.135427 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:59.135327    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:42:59.135615 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:59.135556    2561 patch_prober.go:28] interesting pod/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:42:59.135680 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:59.135622    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 10 14:42:59.201969 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:59.201930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8" event={"ID":"e97aba85-3337-43b5-a16f-ad3303f17b70","Type":"ContainerStarted","Data":"5bf3d05e1de4928ed01953cf9733fa3521b72844da79da8c5cafb99ec82a3031"}
Sep 10 14:42:59.203346 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:59.203320    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb" event={"ID":"f0ed582c-3117-4795-b568-c91c9563823c","Type":"ContainerDied","Data":"eadb4356ded9cf8f7bfea8535e336c9a4e2d69f3f39a5f31422d37f760d0e8f7"}
Sep 10 14:42:59.203346 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:59.203342    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"
Sep 10 14:42:59.203516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:42:59.203370    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eadb4356ded9cf8f7bfea8535e336c9a4e2d69f3f39a5f31422d37f760d0e8f7"
Sep 10 14:43:00.135089 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:00.134977    2561 patch_prober.go:28] interesting pod/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:43:00.135089 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:00.135054    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 10 14:43:00.211280 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:00.211240    2561 generic.go:356] "Generic (PLEG): container finished" podID="e97aba85-3337-43b5-a16f-ad3303f17b70" containerID="37375d461c64c705f2e7d47c893ce8c32100e98f13cc9d6338e1e5fa18625833" exitCode=0
Sep 10 14:43:00.211654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:00.211326    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8" event={"ID":"e97aba85-3337-43b5-a16f-ad3303f17b70","Type":"ContainerDied","Data":"37375d461c64c705f2e7d47c893ce8c32100e98f13cc9d6338e1e5fa18625833"}
Sep 10 14:43:01.134990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:01.134945    2561 patch_prober.go:28] interesting pod/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:43:01.135860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:01.135822    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 10 14:43:01.414517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:01.414489    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"
Sep 10 14:43:01.494191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:01.494158    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97aba85-3337-43b5-a16f-ad3303f17b70-maas-api-service-ca\") pod \"e97aba85-3337-43b5-a16f-ad3303f17b70\" (UID: \"e97aba85-3337-43b5-a16f-ad3303f17b70\") "
Sep 10 14:43:01.494524 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:01.494495    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e97aba85-3337-43b5-a16f-ad3303f17b70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e97aba85-3337-43b5-a16f-ad3303f17b70" (UID: "e97aba85-3337-43b5-a16f-ad3303f17b70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:01.595336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:01.595302    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97aba85-3337-43b5-a16f-ad3303f17b70-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:02.135271 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:02.135223    2561 patch_prober.go:28] interesting pod/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:43:02.135465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:02.135312    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 10 14:43:02.242739 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:02.242124    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8" event={"ID":"e97aba85-3337-43b5-a16f-ad3303f17b70","Type":"ContainerDied","Data":"5bf3d05e1de4928ed01953cf9733fa3521b72844da79da8c5cafb99ec82a3031"}
Sep 10 14:43:02.242739 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:02.242195    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bf3d05e1de4928ed01953cf9733fa3521b72844da79da8c5cafb99ec82a3031"
Sep 10 14:43:02.242739 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:02.242280    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"
Sep 10 14:43:03.012845 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:03.012797    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:43:03.134675 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:03.134630    2561 patch_prober.go:28] interesting pod/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:43:03.134917 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:03.134751    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 10 14:43:04.138724 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:04.138667    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:43:04.139907 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:04.139884    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:43:05.447932 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.447892    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"]
Sep 10 14:43:05.448400 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.448196    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr" podUID="554b182c-e8ed-4fd4-8bd1-143782a225bd" containerName="payload-processing" containerID="cri-o://e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47" gracePeriod=30
Sep 10 14:43:05.746642 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.746608    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:43:05.755334 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.755307    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"]
Sep 10 14:43:05.760725 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.760687    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26c48a75-8wbw8"]
Sep 10 14:43:05.846517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.846477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554b182c-e8ed-4fd4-8bd1-143782a225bd-plugins-config-volume\") pod \"554b182c-e8ed-4fd4-8bd1-143782a225bd\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") "
Sep 10 14:43:05.847097 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.846748    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6kck\" (UniqueName: \"kubernetes.io/projected/554b182c-e8ed-4fd4-8bd1-143782a225bd-kube-api-access-r6kck\") pod \"554b182c-e8ed-4fd4-8bd1-143782a225bd\" (UID: \"554b182c-e8ed-4fd4-8bd1-143782a225bd\") "
Sep 10 14:43:05.847311 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.847162    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/554b182c-e8ed-4fd4-8bd1-143782a225bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "554b182c-e8ed-4fd4-8bd1-143782a225bd" (UID: "554b182c-e8ed-4fd4-8bd1-143782a225bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:05.848044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.847914    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554b182c-e8ed-4fd4-8bd1-143782a225bd-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:05.850864 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.850832    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/554b182c-e8ed-4fd4-8bd1-143782a225bd-kube-api-access-r6kck" (OuterVolumeSpecName: "kube-api-access-r6kck") pod "554b182c-e8ed-4fd4-8bd1-143782a225bd" (UID: "554b182c-e8ed-4fd4-8bd1-143782a225bd"). InnerVolumeSpecName "kube-api-access-r6kck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:05.911135 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.911091    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"]
Sep 10 14:43:05.912025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.911801    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy" containerID="cri-o://78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851" gracePeriod=30
Sep 10 14:43:05.949627 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.949588    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6kck\" (UniqueName: \"kubernetes.io/projected/554b182c-e8ed-4fd4-8bd1-143782a225bd-kube-api-access-r6kck\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:05.997432 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:05.997327    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e97aba85-3337-43b5-a16f-ad3303f17b70" path="/var/lib/kubelet/pods/e97aba85-3337-43b5-a16f-ad3303f17b70/volumes"
Sep 10 14:43:06.043025 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.042987    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"]
Sep 10 14:43:06.048087 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.048058    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-22fb28-s2jgb"]
Sep 10 14:43:06.272118 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.272018    2561 generic.go:356] "Generic (PLEG): container finished" podID="554b182c-e8ed-4fd4-8bd1-143782a225bd" containerID="e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47" exitCode=0
Sep 10 14:43:06.272118 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.272078    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr" event={"ID":"554b182c-e8ed-4fd4-8bd1-143782a225bd","Type":"ContainerDied","Data":"e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47"}
Sep 10 14:43:06.272118 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.272086    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"
Sep 10 14:43:06.272379 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.272123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr" event={"ID":"554b182c-e8ed-4fd4-8bd1-143782a225bd","Type":"ContainerDied","Data":"70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897"}
Sep 10 14:43:06.272379 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.272144    2561 scope.go:117] "RemoveContainer" containerID="e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47"
Sep 10 14:43:06.282224 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.282203    2561 scope.go:117] "RemoveContainer" containerID="e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47"
Sep 10 14:43:06.282553 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:43:06.282533    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47\": container with ID starting with e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47 not found: ID does not exist" containerID="e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47"
Sep 10 14:43:06.282605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.282565    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47"} err="failed to get container status \"e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47\": rpc error: code = NotFound desc = could not find container \"e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47\": container with ID starting with e8a6bfeb54fa128c192698b4efde12624ea9f36eb9e9e5f8176d9184961b1b47 not found: ID does not exist"
Sep 10 14:43:06.304749 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.304698    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"]
Sep 10 14:43:06.314618 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:06.314584    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-26c48a75-54c5bddcdf-sm2pr"]
Sep 10 14:43:07.996743 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:07.996636    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="554b182c-e8ed-4fd4-8bd1-143782a225bd" path="/var/lib/kubelet/pods/554b182c-e8ed-4fd4-8bd1-143782a225bd/volumes"
Sep 10 14:43:07.997442 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:07.997068    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ed582c-3117-4795-b568-c91c9563823c" path="/var/lib/kubelet/pods/f0ed582c-3117-4795-b568-c91c9563823c/volumes"
Sep 10 14:43:11.016312 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:43:11.016281    2561 manager.go:1116] Failed to create existing container: /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554b182c_e8ed_4fd4_8bd1_143782a225bd.slice/crio-70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897: Error finding container 70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897: Status 404 returned error can't find the container with id 70a83250b0805a2145ad8350dd19609332cc50d30dcb31a58399e01872e3c897
Sep 10 14:43:11.175908 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.175849    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:43:11.302752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.302694    2561 generic.go:356] "Generic (PLEG): container finished" podID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerID="78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851" exitCode=0
Sep 10 14:43:11.302752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.302743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" event={"ID":"18cbce08-2186-4b11-a9b5-b7211e61e41f","Type":"ContainerDied","Data":"78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851"}
Sep 10 14:43:11.302968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.302765    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"
Sep 10 14:43:11.302968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.302815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq" event={"ID":"18cbce08-2186-4b11-a9b5-b7211e61e41f","Type":"ContainerDied","Data":"4dbf080f5c6fa7414e807850c47226b37cf63d88d26a885518438833d2811b85"}
Sep 10 14:43:11.302968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.302846    2561 scope.go:117] "RemoveContainer" containerID="78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851"
Sep 10 14:43:11.311648 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.311616    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-socket\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.311797 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.311771    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-podinfo\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.311886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.311861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:11.311951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.311886    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18cbce08-2186-4b11-a9b5-b7211e61e41f-istiod-ca-cert\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.311951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.311916    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-credential-socket\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.312066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.311966    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-token\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.312066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312002    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zfdc\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-kube-api-access-8zfdc\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.312175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312067    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-envoy\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.312175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312155    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-data\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.312291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312214    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:11.312291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312273    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18cbce08-2186-4b11-a9b5-b7211e61e41f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:11.312542 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312521    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-certs\") pod \"18cbce08-2186-4b11-a9b5-b7211e61e41f\" (UID: \"18cbce08-2186-4b11-a9b5-b7211e61e41f\") "
Sep 10 14:43:11.312918 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312618    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-data" (OuterVolumeSpecName: "istio-data") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:11.313085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.312864    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:11.313293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.313232    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18cbce08-2186-4b11-a9b5-b7211e61e41f-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.313293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.313253    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.313293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.313266    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.313449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.313279    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.313449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.313366    2561 scope.go:117] "RemoveContainer" containerID="ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd"
Sep 10 14:43:11.314394 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.314364    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:43:11.314614 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.314517    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-token" (OuterVolumeSpecName: "istio-token") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:11.314670 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.314638    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-kube-api-access-8zfdc" (OuterVolumeSpecName: "kube-api-access-8zfdc") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "kube-api-access-8zfdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:11.314739 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.314663    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18cbce08-2186-4b11-a9b5-b7211e61e41f" (UID: "18cbce08-2186-4b11-a9b5-b7211e61e41f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:11.340054 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.340031    2561 scope.go:117] "RemoveContainer" containerID="78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851"
Sep 10 14:43:11.340450 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:43:11.340428    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851\": container with ID starting with 78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851 not found: ID does not exist" containerID="78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851"
Sep 10 14:43:11.340503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.340462    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851"} err="failed to get container status \"78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851\": rpc error: code = NotFound desc = could not find container \"78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851\": container with ID starting with 78ec2827f72ec4622ab963820050dea4e4e4322a267e4ebb35eb25d972739851 not found: ID does not exist"
Sep 10 14:43:11.340503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.340484    2561 scope.go:117] "RemoveContainer" containerID="ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd"
Sep 10 14:43:11.340915 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:43:11.340886    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd\": container with ID starting with ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd not found: ID does not exist" containerID="ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd"
Sep 10 14:43:11.340971 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.340920    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd"} err="failed to get container status \"ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd\": rpc error: code = NotFound desc = could not find container \"ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd\": container with ID starting with ea87c819fffd58dc7c67f74282db1b455f31a048f58b9c625ae2d8ba442e93dd not found: ID does not exist"
Sep 10 14:43:11.414893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.414846    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.414893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.414887    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.414893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.414898    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zfdc\" (UniqueName: \"kubernetes.io/projected/18cbce08-2186-4b11-a9b5-b7211e61e41f-kube-api-access-8zfdc\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.415168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.414909    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.415168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.414918    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18cbce08-2186-4b11-a9b5-b7211e61e41f-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.627133 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.627101    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"]
Sep 10 14:43:11.635955 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.635923    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-26c48a75-openshift-default-9dcfdc7bd-nmqxq"]
Sep 10 14:43:11.994896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:11.994861    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" path="/var/lib/kubelet/pods/18cbce08-2186-4b11-a9b5-b7211e61e41f/volumes"
Sep 10 14:43:14.232821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:14.232782    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"]
Sep 10 14:43:14.233289 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:14.233002    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy" containerID="cri-o://6865240118aa8ec663ebfc7e83ac2841582293168fd56f508e22bc0729007b1f" gracePeriod=30
Sep 10 14:43:15.048077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.048034    2561 patch_prober.go:28] interesting pod/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:43:15.048285 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.048103    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:43:15.184849 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.184809    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"]
Sep 10 14:43:15.185302 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185289    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e97aba85-3337-43b5-a16f-ad3303f17b70" containerName="revoke-keys"
Sep 10 14:43:15.185343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185304    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e97aba85-3337-43b5-a16f-ad3303f17b70" containerName="revoke-keys"
Sep 10 14:43:15.185343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185320    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ed582c-3117-4795-b568-c91c9563823c" containerName="revoke-keys"
Sep 10 14:43:15.185343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185327    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ed582c-3117-4795-b568-c91c9563823c" containerName="revoke-keys"
Sep 10 14:43:15.185343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185334    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy"
Sep 10 14:43:15.185343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185340    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185351    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185356    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185363    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="554b182c-e8ed-4fd4-8bd1-143782a225bd" containerName="payload-processing"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185368    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="554b182c-e8ed-4fd4-8bd1-143782a225bd" containerName="payload-processing"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185452    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="554b182c-e8ed-4fd4-8bd1-143782a225bd" containerName="payload-processing"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185460    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185465    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ed582c-3117-4795-b568-c91c9563823c" containerName="revoke-keys"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185474    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18cbce08-2186-4b11-a9b5-b7211e61e41f" containerName="istio-proxy"
Sep 10 14:43:15.185496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.185482    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e97aba85-3337-43b5-a16f-ad3303f17b70" containerName="revoke-keys"
Sep 10 14:43:15.188522 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.188504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.191882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.191863    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c072e8-openshift-default-dockercfg-pm9t5\""
Sep 10 14:43:15.219148 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.219113    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"]
Sep 10 14:43:15.364901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.364806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-envoy\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.364901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.364844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-socket\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.364901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.364871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-credential-socket\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.365377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.364917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d627eea-7638-415c-87c7-998e6b46197c-istio-podinfo\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.365377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.364964    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwt76\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-kube-api-access-mwt76\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.365377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.365038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-data\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.365377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.365072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-certs\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.365377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.365119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-istio-token\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.365377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.365142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d627eea-7638-415c-87c7-998e6b46197c-istiod-ca-cert\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.466277 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwt76\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-kube-api-access-mwt76\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.466491 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-data\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.466491 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-certs\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.466645 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-istio-token\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.466645 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d627eea-7638-415c-87c7-998e6b46197c-istiod-ca-cert\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-envoy\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-socket\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-certs\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-credential-socket\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466863    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-data\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.466924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d627eea-7638-415c-87c7-998e6b46197c-istio-podinfo\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.467115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-socket\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.467172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-credential-socket\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.467402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.467270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d627eea-7638-415c-87c7-998e6b46197c-istiod-ca-cert\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.468998 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.468972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-envoy\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.469267 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.469249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d627eea-7638-415c-87c7-998e6b46197c-istio-podinfo\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.484112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.484086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-istio-token\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.484226 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.484131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwt76\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-kube-api-access-mwt76\") pod \"e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") " pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.500095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.500070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:15.780829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.780794    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"]
Sep 10 14:43:15.782008 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:43:15.781976    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d627eea_7638_415c_87c7_998e6b46197c.slice/crio-4142c29b208102256831a902f5ab85ccea1fcec4fb526c35b88222d46c9167b7 WatchSource:0}: Error finding container 4142c29b208102256831a902f5ab85ccea1fcec4fb526c35b88222d46c9167b7: Status 404 returned error can't find the container with id 4142c29b208102256831a902f5ab85ccea1fcec4fb526c35b88222d46c9167b7
Sep 10 14:43:15.784457 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.784415    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:43:15.784557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.784495    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:43:15.784557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:15.784526    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:43:16.352202 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:16.352162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" event={"ID":"5d627eea-7638-415c-87c7-998e6b46197c","Type":"ContainerStarted","Data":"a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798"}
Sep 10 14:43:16.352404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:16.352227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" event={"ID":"5d627eea-7638-415c-87c7-998e6b46197c","Type":"ContainerStarted","Data":"4142c29b208102256831a902f5ab85ccea1fcec4fb526c35b88222d46c9167b7"}
Sep 10 14:43:16.400724 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:16.400659    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" podStartSLOduration=1.400639384 podStartE2EDuration="1.400639384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:16.398292206 +0000 UTC m=+910.862658729" watchObservedRunningTime="2026-09-10 14:43:16.400639384 +0000 UTC m=+910.865005906"
Sep 10 14:43:16.501046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:16.501009    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:16.506751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:16.506692    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:17.358241 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:17.358214    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:17.359234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:17.359211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:19.374008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.373974    2561 generic.go:356] "Generic (PLEG): container finished" podID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerID="6865240118aa8ec663ebfc7e83ac2841582293168fd56f508e22bc0729007b1f" exitCode=0
Sep 10 14:43:19.374402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.374042    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" event={"ID":"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe","Type":"ContainerDied","Data":"6865240118aa8ec663ebfc7e83ac2841582293168fd56f508e22bc0729007b1f"}
Sep 10 14:43:19.374402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.374105    2561 scope.go:117] "RemoveContainer" containerID="a745027573c3f2067d6523aa280fd4557839031ed5ceb41185609f1d93de4458"
Sep 10 14:43:19.502475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.502398    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:43:19.614541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614508    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-envoy\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.614541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614544    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-socket\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.614793 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614604    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvxtd\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-kube-api-access-jvxtd\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.614793 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614656    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-credential-socket\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.614793 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614680    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-podinfo\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.614793 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614732    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-certs\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.614793 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614767    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-data\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.615038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614889    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-token\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.615038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:19.615038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.614936    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istiod-ca-cert\") pod \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\" (UID: \"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe\") "
Sep 10 14:43:19.615204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615082    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:19.615343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615286    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:19.615420 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615349    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:19.615420 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615398    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:19.615636 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615616    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.615719 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615641    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.615719 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615657    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.615719 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615670    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.615719 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.615683    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.617085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.617061    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:19.617378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.617344    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:43:19.617514 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.617451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:19.617748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.617696    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-kube-api-access-jvxtd" (OuterVolumeSpecName: "kube-api-access-jvxtd") pod "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" (UID: "2cf23eb0-4c8f-4a3d-912d-870ae3da35fe"). InnerVolumeSpecName "kube-api-access-jvxtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:19.716615 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.716579    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.716615 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.716615    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvxtd\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-kube-api-access-jvxtd\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.716874 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.716630    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.716874 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:19.716643    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:43:20.381429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:20.381331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl" event={"ID":"2cf23eb0-4c8f-4a3d-912d-870ae3da35fe","Type":"ContainerDied","Data":"c022652e290fa8d28462aa78951766cf43b5105fe5751bc48d3e4d05ea0b8fc2"}
Sep 10 14:43:20.381429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:20.381351    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"
Sep 10 14:43:20.381429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:20.381395    2561 scope.go:117] "RemoveContainer" containerID="6865240118aa8ec663ebfc7e83ac2841582293168fd56f508e22bc0729007b1f"
Sep 10 14:43:20.417949 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:20.417911    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"]
Sep 10 14:43:20.428078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:20.428040    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-22fb28-openshift-default-566dd574c8-r58hl"]
Sep 10 14:43:21.058005 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.057969    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"]
Sep 10 14:43:21.058464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.058451    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy"
Sep 10 14:43:21.058510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.058466    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy"
Sep 10 14:43:21.058510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.058474    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy"
Sep 10 14:43:21.058510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.058480    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy"
Sep 10 14:43:21.058603 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.058541    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy"
Sep 10 14:43:21.058603 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.058552    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" containerName="istio-proxy"
Sep 10 14:43:21.063055 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.063038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.067638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.067617    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c072e8-dockercfg-lttn7\""
Sep 10 14:43:21.068193 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.068171    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c072e8\""
Sep 10 14:43:21.084253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.084231    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"]
Sep 10 14:43:21.133388 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.133346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq4kf\" (UniqueName: \"kubernetes.io/projected/bb1c84da-24a3-4c0a-9061-b335f7822273-kube-api-access-fq4kf\") pod \"payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.133915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.133883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1c84da-24a3-4c0a-9061-b335f7822273-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.235524 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.235489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1c84da-24a3-4c0a-9061-b335f7822273-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.235734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.235547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4kf\" (UniqueName: \"kubernetes.io/projected/bb1c84da-24a3-4c0a-9061-b335f7822273-kube-api-access-fq4kf\") pod \"payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.236208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.236187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1c84da-24a3-4c0a-9061-b335f7822273-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.246201 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.246170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq4kf\" (UniqueName: \"kubernetes.io/projected/bb1c84da-24a3-4c0a-9061-b335f7822273-kube-api-access-fq4kf\") pod \"payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.373066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.372980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:21.659837 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.659810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"]
Sep 10 14:43:21.661867 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:43:21.661840    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1c84da_24a3_4c0a_9061_b335f7822273.slice/crio-47cec12b3ddc97410a1f700f2e5fe12bf6fda8b649fdf61558ac8e2663436f27 WatchSource:0}: Error finding container 47cec12b3ddc97410a1f700f2e5fe12bf6fda8b649fdf61558ac8e2663436f27: Status 404 returned error can't find the container with id 47cec12b3ddc97410a1f700f2e5fe12bf6fda8b649fdf61558ac8e2663436f27
Sep 10 14:43:21.994286 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:21.994210    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf23eb0-4c8f-4a3d-912d-870ae3da35fe" path="/var/lib/kubelet/pods/2cf23eb0-4c8f-4a3d-912d-870ae3da35fe/volumes"
Sep 10 14:43:22.396645 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:22.396617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m" event={"ID":"bb1c84da-24a3-4c0a-9061-b335f7822273","Type":"ContainerStarted","Data":"9c2291525bb7d76a5f49c84b8ea60eba0341ef87e597797e46136f333fe36715"}
Sep 10 14:43:22.396828 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:22.396668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m" event={"ID":"bb1c84da-24a3-4c0a-9061-b335f7822273","Type":"ContainerStarted","Data":"47cec12b3ddc97410a1f700f2e5fe12bf6fda8b649fdf61558ac8e2663436f27"}
Sep 10 14:43:22.396828 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:22.396756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:22.421119 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:22.421058    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m" podStartSLOduration=1.4210375069999999 podStartE2EDuration="1.421037507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:22.419841157 +0000 UTC m=+916.884207679" watchObservedRunningTime="2026-09-10 14:43:22.421037507 +0000 UTC m=+916.885404030"
Sep 10 14:43:33.405669 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:33.405638    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:43:38.502916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:38.502879    2561 generic.go:356] "Generic (PLEG): container finished" podID="5d627eea-7638-415c-87c7-998e6b46197c" containerID="a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798" exitCode=0
Sep 10 14:43:38.503426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:38.502961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" event={"ID":"5d627eea-7638-415c-87c7-998e6b46197c","Type":"ContainerDied","Data":"a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798"}
Sep 10 14:43:38.503535 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:38.503517    2561 scope.go:117] "RemoveContainer" containerID="a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798"
Sep 10 14:43:38.504828 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:38.504797    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:43:38.504924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:38.504866    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:43:38.504924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:38.504895    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:43:39.515045 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:39.515005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" event={"ID":"5d627eea-7638-415c-87c7-998e6b46197c","Type":"ContainerStarted","Data":"9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6"}
Sep 10 14:43:40.501204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:40.501167    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:40.501388 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:40.501364    2561 patch_prober.go:28] interesting pod/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:43:40.501446 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:40.501416    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 14:43:41.501068 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:41.501034    2561 patch_prober.go:28] interesting pod/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:43:41.501459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:41.501099    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 14:43:42.500616 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:42.500579    2561 patch_prober.go:28] interesting pod/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:43:42.500834 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:42.500641    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 14:43:43.501505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:43.501469    2561 patch_prober.go:28] interesting pod/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:43:43.501985 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:43.501526    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 14:43:44.501062 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:44.501018    2561 patch_prober.go:28] interesting pod/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:43:44.501275 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:44.501074    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 14:43:45.506070 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.506037    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:45.506783 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.506752    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:45.507520 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.507490    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:43:45.528433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.528397    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"]
Sep 10 14:43:45.532692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.532663    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.535454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.535430    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9b1e67\"/\"kube-root-ca.crt\""
Sep 10 14:43:45.535598 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.535472    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9b1e67\"/\"default-dockercfg-cx7lb\""
Sep 10 14:43:45.535598 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.535536    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-9b1e67\"/\"openshift-service-ca.crt\""
Sep 10 14:43:45.535598 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.535478    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-9b1e67\"/\"premium-w0-9b1e67-kserve-self-signed-certs\""
Sep 10 14:43:45.542130 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.542109    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"]
Sep 10 14:43:45.715737 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.714036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-home\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.715737 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.714206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tls-certs\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.715737 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.714237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tmp-dir\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.715737 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.714276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-model-cache\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.715737 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.714308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-dshm\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.715737 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.714406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbz75\" (UniqueName: \"kubernetes.io/projected/a4c1d322-e38f-446a-a1a5-2d7c46361a70-kube-api-access-qbz75\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.815579 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.815484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-home\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.815777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.815589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tls-certs\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.815777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.815611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tmp-dir\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.815777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.815629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-model-cache\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.815777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.815654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-dshm\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.815777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.815757    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbz75\" (UniqueName: \"kubernetes.io/projected/a4c1d322-e38f-446a-a1a5-2d7c46361a70-kube-api-access-qbz75\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.816075 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.815967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-home\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.816075 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.816000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tmp-dir\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.816184 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.816109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-model-cache\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.817968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.817945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-dshm\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.818124 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.818109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tls-certs\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.823275 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.823253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbz75\" (UniqueName: \"kubernetes.io/projected/a4c1d322-e38f-446a-a1a5-2d7c46361a70-kube-api-access-qbz75\") pod \"premium-w0-9b1e67-kserve-d979df694-ct5k6\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") " pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:45.843791 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:45.843766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:46.117054 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:46.117029    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"]
Sep 10 14:43:46.118552 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:43:46.118520    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4c1d322_e38f_446a_a1a5_2d7c46361a70.slice/crio-fb6dba5ee9b04b5a326084d4e1ac1905f2878e316eb9f4c9c81ec8b15515a2e1 WatchSource:0}: Error finding container fb6dba5ee9b04b5a326084d4e1ac1905f2878e316eb9f4c9c81ec8b15515a2e1: Status 404 returned error can't find the container with id fb6dba5ee9b04b5a326084d4e1ac1905f2878e316eb9f4c9c81ec8b15515a2e1
Sep 10 14:43:46.571779 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:46.571743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6" event={"ID":"a4c1d322-e38f-446a-a1a5-2d7c46361a70","Type":"ContainerStarted","Data":"af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126"}
Sep 10 14:43:46.572157 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:46.571795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6" event={"ID":"a4c1d322-e38f-446a-a1a5-2d7c46361a70","Type":"ContainerStarted","Data":"fb6dba5ee9b04b5a326084d4e1ac1905f2878e316eb9f4c9c81ec8b15515a2e1"}
Sep 10 14:43:46.595257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:46.595203    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6" podStartSLOduration=1.595188072 podStartE2EDuration="1.595188072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:46.592025269 +0000 UTC m=+941.056391803" watchObservedRunningTime="2026-09-10 14:43:46.595188072 +0000 UTC m=+941.059554593"
Sep 10 14:43:55.844320 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:55.844280    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:55.844766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:55.844333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:55.856969 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:55.856935    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:43:56.649455 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:43:56.649423    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:44:40.231523 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.231437    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"]
Sep 10 14:44:40.234325 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.234304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"
Sep 10 14:44:40.237332 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.237310    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:44:40.242543 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.242515    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"]
Sep 10 14:44:40.335858 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.335813    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9673c3-698a-449c-a6fe-e8bdb220fd58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx\" (UID: \"4a9673c3-698a-449c-a6fe-e8bdb220fd58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"
Sep 10 14:44:40.437111 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.437075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9673c3-698a-449c-a6fe-e8bdb220fd58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx\" (UID: \"4a9673c3-698a-449c-a6fe-e8bdb220fd58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"
Sep 10 14:44:40.437737 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.437700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9673c3-698a-449c-a6fe-e8bdb220fd58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx\" (UID: \"4a9673c3-698a-449c-a6fe-e8bdb220fd58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"
Sep 10 14:44:40.547339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.547249    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"
Sep 10 14:44:40.820522 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.820431    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"]
Sep 10 14:44:40.834735 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:44:40.834662    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9673c3_698a_449c_a6fe_e8bdb220fd58.slice/crio-26c66c68c9bade27bfa3d10afbd45e6f7a17de01094f040d88e483874072d25b WatchSource:0}: Error finding container 26c66c68c9bade27bfa3d10afbd45e6f7a17de01094f040d88e483874072d25b: Status 404 returned error can't find the container with id 26c66c68c9bade27bfa3d10afbd45e6f7a17de01094f040d88e483874072d25b
Sep 10 14:44:40.909022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:40.908980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx" event={"ID":"4a9673c3-698a-449c-a6fe-e8bdb220fd58","Type":"ContainerStarted","Data":"26c66c68c9bade27bfa3d10afbd45e6f7a17de01094f040d88e483874072d25b"}
Sep 10 14:44:41.917471 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:41.917429    2561 generic.go:356] "Generic (PLEG): container finished" podID="4a9673c3-698a-449c-a6fe-e8bdb220fd58" containerID="055b7fe7ea73c803a65fa97479337f9318ae1093f9be8cfd04e39506df937aef" exitCode=0
Sep 10 14:44:41.917920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:41.917519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx" event={"ID":"4a9673c3-698a-449c-a6fe-e8bdb220fd58","Type":"ContainerDied","Data":"055b7fe7ea73c803a65fa97479337f9318ae1093f9be8cfd04e39506df937aef"}
Sep 10 14:44:43.070816 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:43.070789    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"
Sep 10 14:44:43.171104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:43.171064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9673c3-698a-449c-a6fe-e8bdb220fd58-maas-api-service-ca\") pod \"4a9673c3-698a-449c-a6fe-e8bdb220fd58\" (UID: \"4a9673c3-698a-449c-a6fe-e8bdb220fd58\") "
Sep 10 14:44:43.171471 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:43.171446    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a9673c3-698a-449c-a6fe-e8bdb220fd58-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a9673c3-698a-449c-a6fe-e8bdb220fd58" (UID: "4a9673c3-698a-449c-a6fe-e8bdb220fd58"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:44:43.272196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:43.272107    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9673c3-698a-449c-a6fe-e8bdb220fd58-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:44:43.932435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:43.932404    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"
Sep 10 14:44:43.932633 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:43.932450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx" event={"ID":"4a9673c3-698a-449c-a6fe-e8bdb220fd58","Type":"ContainerDied","Data":"26c66c68c9bade27bfa3d10afbd45e6f7a17de01094f040d88e483874072d25b"}
Sep 10 14:44:43.932633 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:43.932504    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26c66c68c9bade27bfa3d10afbd45e6f7a17de01094f040d88e483874072d25b"
Sep 10 14:44:44.957443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:44.957411    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"]
Sep 10 14:44:44.957940 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:44.957925    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a9673c3-698a-449c-a6fe-e8bdb220fd58" containerName="revoke-keys"
Sep 10 14:44:44.957997 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:44.957942    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a9673c3-698a-449c-a6fe-e8bdb220fd58" containerName="revoke-keys"
Sep 10 14:44:44.958038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:44.958027    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a9673c3-698a-449c-a6fe-e8bdb220fd58" containerName="revoke-keys"
Sep 10 14:44:44.960083 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:44.960067    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:44.962833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:44.962806    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-785829b5-openshift-default-dockercfg-bfct5\""
Sep 10 14:44:44.975187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:44.975161    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"]
Sep 10 14:44:45.089445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-credential-socket\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.089689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-data\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.089689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-istio-token\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.089689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vksmt\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-kube-api-access-vksmt\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.089689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-socket\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.089689 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1036ad5b-beb8-434b-8caf-39596c48291b-istiod-ca-cert\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.090113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1036ad5b-beb8-434b-8caf-39596c48291b-istio-podinfo\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.090113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-certs\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.090113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.089820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-envoy\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191137 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-envoy\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-credential-socket\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-data\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-istio-token\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191339 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vksmt\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-kube-api-access-vksmt\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-socket\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1036ad5b-beb8-434b-8caf-39596c48291b-istiod-ca-cert\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1036ad5b-beb8-434b-8caf-39596c48291b-istio-podinfo\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-certs\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191673    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-credential-socket\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-data\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.191954 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.191928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-socket\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.192046 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.192027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-certs\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.192347 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.192322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1036ad5b-beb8-434b-8caf-39596c48291b-istiod-ca-cert\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.193529 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.193512    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-envoy\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.193998 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.193980    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1036ad5b-beb8-434b-8caf-39596c48291b-istio-podinfo\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.200555 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.200531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-istio-token\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.200897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.200875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vksmt\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-kube-api-access-vksmt\") pod \"e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") " pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.270785 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.270683    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:45.575714 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.575678    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"]
Sep 10 14:44:45.576996 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:44:45.576971    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1036ad5b_beb8_434b_8caf_39596c48291b.slice/crio-fd582355c5f863669dcc28eb3b11b098733a6a5338a681fb911290ad5ea36500 WatchSource:0}: Error finding container fd582355c5f863669dcc28eb3b11b098733a6a5338a681fb911290ad5ea36500: Status 404 returned error can't find the container with id fd582355c5f863669dcc28eb3b11b098733a6a5338a681fb911290ad5ea36500
Sep 10 14:44:45.579507 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.579474    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:44:45.579577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.579542    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:44:45.579577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.579572    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:44:45.950624 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.950586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" event={"ID":"1036ad5b-beb8-434b-8caf-39596c48291b","Type":"ContainerStarted","Data":"c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e"}
Sep 10 14:44:45.950905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.950648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" event={"ID":"1036ad5b-beb8-434b-8caf-39596c48291b","Type":"ContainerStarted","Data":"fd582355c5f863669dcc28eb3b11b098733a6a5338a681fb911290ad5ea36500"}
Sep 10 14:44:45.975499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:45.975441    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podStartSLOduration=1.9754231020000002 podStartE2EDuration="1.975423102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:45.973973267 +0000 UTC m=+1000.438339791" watchObservedRunningTime="2026-09-10 14:44:45.975423102 +0000 UTC m=+1000.439789624"
Sep 10 14:44:46.271023 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:46.270931    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:46.276344 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:46.276314    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:46.956675 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:46.956643    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:46.957817 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:46.957796    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:44:50.775262 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:50.775223    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"]
Sep 10 14:44:50.775771 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:50.775493    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m" podUID="bb1c84da-24a3-4c0a-9061-b335f7822273" containerName="payload-pre-processing" containerID="cri-o://9c2291525bb7d76a5f49c84b8ea60eba0341ef87e597797e46136f333fe36715" gracePeriod=30
Sep 10 14:44:50.957592 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:50.957543    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"]
Sep 10 14:44:50.961788 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:50.961755    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c072e8-dnbfx"]
Sep 10 14:44:50.982143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:50.982107    2561 generic.go:356] "Generic (PLEG): container finished" podID="bb1c84da-24a3-4c0a-9061-b335f7822273" containerID="9c2291525bb7d76a5f49c84b8ea60eba0341ef87e597797e46136f333fe36715" exitCode=0
Sep 10 14:44:50.982307 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:50.982188    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m" event={"ID":"bb1c84da-24a3-4c0a-9061-b335f7822273","Type":"ContainerDied","Data":"9c2291525bb7d76a5f49c84b8ea60eba0341ef87e597797e46136f333fe36715"}
Sep 10 14:44:51.073934 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.073885    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:44:51.164168 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.164133    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq4kf\" (UniqueName: \"kubernetes.io/projected/bb1c84da-24a3-4c0a-9061-b335f7822273-kube-api-access-fq4kf\") pod \"bb1c84da-24a3-4c0a-9061-b335f7822273\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") "
Sep 10 14:44:51.164450 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.164348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1c84da-24a3-4c0a-9061-b335f7822273-plugins-config-volume\") pod \"bb1c84da-24a3-4c0a-9061-b335f7822273\" (UID: \"bb1c84da-24a3-4c0a-9061-b335f7822273\") "
Sep 10 14:44:51.164860 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.164827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb1c84da-24a3-4c0a-9061-b335f7822273-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb1c84da-24a3-4c0a-9061-b335f7822273" (UID: "bb1c84da-24a3-4c0a-9061-b335f7822273"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:44:51.166423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.166401    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1c84da-24a3-4c0a-9061-b335f7822273-kube-api-access-fq4kf" (OuterVolumeSpecName: "kube-api-access-fq4kf") pod "bb1c84da-24a3-4c0a-9061-b335f7822273" (UID: "bb1c84da-24a3-4c0a-9061-b335f7822273"). InnerVolumeSpecName "kube-api-access-fq4kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:44:51.266082 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.266041    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb1c84da-24a3-4c0a-9061-b335f7822273-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:44:51.266082 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.266075    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq4kf\" (UniqueName: \"kubernetes.io/projected/bb1c84da-24a3-4c0a-9061-b335f7822273-kube-api-access-fq4kf\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:44:51.989175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.989145    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"
Sep 10 14:44:51.996056 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.996014    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a9673c3-698a-449c-a6fe-e8bdb220fd58" path="/var/lib/kubelet/pods/4a9673c3-698a-449c-a6fe-e8bdb220fd58/volumes"
Sep 10 14:44:51.996565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.996538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m" event={"ID":"bb1c84da-24a3-4c0a-9061-b335f7822273","Type":"ContainerDied","Data":"47cec12b3ddc97410a1f700f2e5fe12bf6fda8b649fdf61558ac8e2663436f27"}
Sep 10 14:44:51.996700 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:51.996670    2561 scope.go:117] "RemoveContainer" containerID="9c2291525bb7d76a5f49c84b8ea60eba0341ef87e597797e46136f333fe36715"
Sep 10 14:44:52.013990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:52.013966    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"]
Sep 10 14:44:52.017796 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:52.017774    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c072e8-cf44988c8-j5m2m"]
Sep 10 14:44:53.072661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.072622    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"]
Sep 10 14:44:53.073167 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.073152    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1c84da-24a3-4c0a-9061-b335f7822273" containerName="payload-pre-processing"
Sep 10 14:44:53.073219 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.073169    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1c84da-24a3-4c0a-9061-b335f7822273" containerName="payload-pre-processing"
Sep 10 14:44:53.073254 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.073237    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1c84da-24a3-4c0a-9061-b335f7822273" containerName="payload-pre-processing"
Sep 10 14:44:53.075882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.075862    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.078838 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.078813    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-785829b5\""
Sep 10 14:44:53.078974 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.078887    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-785829b5-dockercfg-sm4rp\""
Sep 10 14:44:53.087117 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.087085    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"]
Sep 10 14:44:53.189136 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.188915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hj6r\" (UniqueName: \"kubernetes.io/projected/51b410e0-8472-49bd-9201-39fd1989c237-kube-api-access-5hj6r\") pod \"payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") " pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.189136 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.189086    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51b410e0-8472-49bd-9201-39fd1989c237-plugins-config-volume\") pod \"payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") " pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.290314 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.290276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hj6r\" (UniqueName: \"kubernetes.io/projected/51b410e0-8472-49bd-9201-39fd1989c237-kube-api-access-5hj6r\") pod \"payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") " pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.290537 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.290394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51b410e0-8472-49bd-9201-39fd1989c237-plugins-config-volume\") pod \"payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") " pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.291226 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.291200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51b410e0-8472-49bd-9201-39fd1989c237-plugins-config-volume\") pod \"payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") " pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.299039 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.299012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hj6r\" (UniqueName: \"kubernetes.io/projected/51b410e0-8472-49bd-9201-39fd1989c237-kube-api-access-5hj6r\") pod \"payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") " pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.387465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.387375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:53.663910 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.663861    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"]
Sep 10 14:44:53.665487 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:44:53.665459    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b410e0_8472_49bd_9201_39fd1989c237.slice/crio-f21d566a756a616caa5cd9861c4f1a8d25cd697df9585bb17f06169cca17374f WatchSource:0}: Error finding container f21d566a756a616caa5cd9861c4f1a8d25cd697df9585bb17f06169cca17374f: Status 404 returned error can't find the container with id f21d566a756a616caa5cd9861c4f1a8d25cd697df9585bb17f06169cca17374f
Sep 10 14:44:53.995476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:53.995392    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb1c84da-24a3-4c0a-9061-b335f7822273" path="/var/lib/kubelet/pods/bb1c84da-24a3-4c0a-9061-b335f7822273/volumes"
Sep 10 14:44:54.003176 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:54.003128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd" event={"ID":"51b410e0-8472-49bd-9201-39fd1989c237","Type":"ContainerStarted","Data":"2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c"}
Sep 10 14:44:54.003363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:54.003198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd" event={"ID":"51b410e0-8472-49bd-9201-39fd1989c237","Type":"ContainerStarted","Data":"f21d566a756a616caa5cd9861c4f1a8d25cd697df9585bb17f06169cca17374f"}
Sep 10 14:44:54.003445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:54.003356    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:44:54.021844 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:44:54.021787    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd" podStartSLOduration=1.021769609 podStartE2EDuration="1.021769609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:54.020109146 +0000 UTC m=+1008.484475667" watchObservedRunningTime="2026-09-10 14:44:54.021769609 +0000 UTC m=+1008.486136132"
Sep 10 14:45:00.141278 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.141227    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"]
Sep 10 14:45:00.144915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.144883    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"]
Sep 10 14:45:00.145200 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.144999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"
Sep 10 14:45:00.147916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.147890    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:45:00.148684 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.148653    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"]
Sep 10 14:45:00.148809 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.148783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"
Sep 10 14:45:00.152644 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.152613    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"]
Sep 10 14:45:00.153185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.153161    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"
Sep 10 14:45:00.156357 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.156213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"
Sep 10 14:45:00.156832 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.156813    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"]
Sep 10 14:45:00.160846 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.160810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"]
Sep 10 14:45:00.162694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.161859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"
Sep 10 14:45:00.167479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.165186    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"]
Sep 10 14:45:00.173314 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.172548    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"]
Sep 10 14:45:00.198379 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.198337    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"
Sep 10 14:45:00.245543 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.245145    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"
Sep 10 14:45:00.258312 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.258288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"
Sep 10 14:45:00.450929 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.450897    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"]
Sep 10 14:45:00.451875 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:45:00.451849    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c107aa_540c_480b_913c_7b078de3f0fe.slice/crio-4b0d2edca45ca89bda08eb2aabe9620ce9459d1c386b8d8225f43df0b5f3f4b7 WatchSource:0}: Error finding container 4b0d2edca45ca89bda08eb2aabe9620ce9459d1c386b8d8225f43df0b5f3f4b7: Status 404 returned error can't find the container with id 4b0d2edca45ca89bda08eb2aabe9620ce9459d1c386b8d8225f43df0b5f3f4b7
Sep 10 14:45:00.497159 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.497135    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"]
Sep 10 14:45:00.498055 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:45:00.498030    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05bb995_9c0f_4836_a91c_f2be105e0729.slice/crio-479353fa32700182caf8991278fa52a3c4a85fcc233bee204b52e6799cc2db43 WatchSource:0}: Error finding container 479353fa32700182caf8991278fa52a3c4a85fcc233bee204b52e6799cc2db43: Status 404 returned error can't find the container with id 479353fa32700182caf8991278fa52a3c4a85fcc233bee204b52e6799cc2db43
Sep 10 14:45:00.541053 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.541024    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"]
Sep 10 14:45:00.542056 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:45:00.542028    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9ef369_4f0b_49c8_9e44_816c2f93afce.slice/crio-a104b7e8526265baa760ca7db3c857d5e01ee1290dc6b4dc56802648bd522abf WatchSource:0}: Error finding container a104b7e8526265baa760ca7db3c857d5e01ee1290dc6b4dc56802648bd522abf: Status 404 returned error can't find the container with id a104b7e8526265baa760ca7db3c857d5e01ee1290dc6b4dc56802648bd522abf
Sep 10 14:45:00.559835 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:00.559810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"]
Sep 10 14:45:00.561346 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:45:00.561315    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bfac49_cc02_438f_8155_c702e0fd6019.slice/crio-ac1186bc0fab3a9c23672bae368c995f0ede89f156ba6c3313f9460bc459ad64 WatchSource:0}: Error finding container ac1186bc0fab3a9c23672bae368c995f0ede89f156ba6c3313f9460bc459ad64: Status 404 returned error can't find the container with id ac1186bc0fab3a9c23672bae368c995f0ede89f156ba6c3313f9460bc459ad64
Sep 10 14:45:01.048097 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.048055    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g" event={"ID":"91bfac49-cc02-438f-8155-c702e0fd6019","Type":"ContainerStarted","Data":"fa902bf9c0195500bd5dbfae3295e85760b56dea4454dd403f07e0cb2a669052"}
Sep 10 14:45:01.048329 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.048131    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g" event={"ID":"91bfac49-cc02-438f-8155-c702e0fd6019","Type":"ContainerStarted","Data":"ac1186bc0fab3a9c23672bae368c995f0ede89f156ba6c3313f9460bc459ad64"}
Sep 10 14:45:01.050075 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.050043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj" event={"ID":"b05bb995-9c0f-4836-a91c-f2be105e0729","Type":"ContainerStarted","Data":"66f20b32528123085397f35a23fa0a6577b1c0de391880a5ebfa9e11ca47d628"}
Sep 10 14:45:01.050208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.050103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj" event={"ID":"b05bb995-9c0f-4836-a91c-f2be105e0729","Type":"ContainerStarted","Data":"479353fa32700182caf8991278fa52a3c4a85fcc233bee204b52e6799cc2db43"}
Sep 10 14:45:01.051830 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.051807    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp" event={"ID":"2e9ef369-4f0b-49c8-9e44-816c2f93afce","Type":"ContainerStarted","Data":"0d2b6a800468e7473742a4fbb715c1217d38bfff2407d3014bb3fbbb5af0c62c"}
Sep 10 14:45:01.051928 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.051845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp" event={"ID":"2e9ef369-4f0b-49c8-9e44-816c2f93afce","Type":"ContainerStarted","Data":"a104b7e8526265baa760ca7db3c857d5e01ee1290dc6b4dc56802648bd522abf"}
Sep 10 14:45:01.053518 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.053494    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp" event={"ID":"17c107aa-540c-480b-913c-7b078de3f0fe","Type":"ContainerStarted","Data":"224a68cd879fa5203b39ab1c42fc5df2ed788930628a889c840eb69db08d5ddb"}
Sep 10 14:45:01.053605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.053540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp" event={"ID":"17c107aa-540c-480b-913c-7b078de3f0fe","Type":"ContainerStarted","Data":"4b0d2edca45ca89bda08eb2aabe9620ce9459d1c386b8d8225f43df0b5f3f4b7"}
Sep 10 14:45:01.065409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.065351    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g" podStartSLOduration=1.065335667 podStartE2EDuration="1.065335667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.062740612 +0000 UTC m=+1015.527107136" watchObservedRunningTime="2026-09-10 14:45:01.065335667 +0000 UTC m=+1015.529702189"
Sep 10 14:45:01.079483 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.079402    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj" podStartSLOduration=1.079386838 podStartE2EDuration="1.079386838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.076916783 +0000 UTC m=+1015.541283306" watchObservedRunningTime="2026-09-10 14:45:01.079386838 +0000 UTC m=+1015.543753369"
Sep 10 14:45:01.092811 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.092742    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp" podStartSLOduration=1.092720175 podStartE2EDuration="1.092720175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.091349913 +0000 UTC m=+1015.555716436" watchObservedRunningTime="2026-09-10 14:45:01.092720175 +0000 UTC m=+1015.557086695"
Sep 10 14:45:01.107639 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:01.107583    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp" podStartSLOduration=1.107569808 podStartE2EDuration="1.107569808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.105122848 +0000 UTC m=+1015.569489371" watchObservedRunningTime="2026-09-10 14:45:01.107569808 +0000 UTC m=+1015.571936329"
Sep 10 14:45:02.065343 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.065308    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e9ef369-4f0b-49c8-9e44-816c2f93afce" containerID="0d2b6a800468e7473742a4fbb715c1217d38bfff2407d3014bb3fbbb5af0c62c" exitCode=0
Sep 10 14:45:02.065867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.065388    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp" event={"ID":"2e9ef369-4f0b-49c8-9e44-816c2f93afce","Type":"ContainerDied","Data":"0d2b6a800468e7473742a4fbb715c1217d38bfff2407d3014bb3fbbb5af0c62c"}
Sep 10 14:45:02.067043 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.067012    2561 generic.go:356] "Generic (PLEG): container finished" podID="17c107aa-540c-480b-913c-7b078de3f0fe" containerID="224a68cd879fa5203b39ab1c42fc5df2ed788930628a889c840eb69db08d5ddb" exitCode=0
Sep 10 14:45:02.067143 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.067060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp" event={"ID":"17c107aa-540c-480b-913c-7b078de3f0fe","Type":"ContainerDied","Data":"224a68cd879fa5203b39ab1c42fc5df2ed788930628a889c840eb69db08d5ddb"}
Sep 10 14:45:02.068890 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.068864    2561 generic.go:356] "Generic (PLEG): container finished" podID="91bfac49-cc02-438f-8155-c702e0fd6019" containerID="fa902bf9c0195500bd5dbfae3295e85760b56dea4454dd403f07e0cb2a669052" exitCode=0
Sep 10 14:45:02.069031 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.068951    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g" event={"ID":"91bfac49-cc02-438f-8155-c702e0fd6019","Type":"ContainerDied","Data":"fa902bf9c0195500bd5dbfae3295e85760b56dea4454dd403f07e0cb2a669052"}
Sep 10 14:45:02.070555 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.070530    2561 generic.go:356] "Generic (PLEG): container finished" podID="b05bb995-9c0f-4836-a91c-f2be105e0729" containerID="66f20b32528123085397f35a23fa0a6577b1c0de391880a5ebfa9e11ca47d628" exitCode=0
Sep 10 14:45:02.070656 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:02.070612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj" event={"ID":"b05bb995-9c0f-4836-a91c-f2be105e0729","Type":"ContainerDied","Data":"66f20b32528123085397f35a23fa0a6577b1c0de391880a5ebfa9e11ca47d628"}
Sep 10 14:45:03.245421 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:03.245391    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"
Sep 10 14:45:03.318049 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:03.318019    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"
Sep 10 14:45:03.321464 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:03.321434    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"
Sep 10 14:45:03.325175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:03.325154    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"
Sep 10 14:45:04.085267 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.085233    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"
Sep 10 14:45:04.085432 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.085267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g" event={"ID":"91bfac49-cc02-438f-8155-c702e0fd6019","Type":"ContainerDied","Data":"ac1186bc0fab3a9c23672bae368c995f0ede89f156ba6c3313f9460bc459ad64"}
Sep 10 14:45:04.085432 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.085347    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac1186bc0fab3a9c23672bae368c995f0ede89f156ba6c3313f9460bc459ad64"
Sep 10 14:45:04.086775 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.086749    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"
Sep 10 14:45:04.086927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.086753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj" event={"ID":"b05bb995-9c0f-4836-a91c-f2be105e0729","Type":"ContainerDied","Data":"479353fa32700182caf8991278fa52a3c4a85fcc233bee204b52e6799cc2db43"}
Sep 10 14:45:04.086985 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.086940    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="479353fa32700182caf8991278fa52a3c4a85fcc233bee204b52e6799cc2db43"
Sep 10 14:45:04.088351 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.088332    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"
Sep 10 14:45:04.088475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.088354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp" event={"ID":"2e9ef369-4f0b-49c8-9e44-816c2f93afce","Type":"ContainerDied","Data":"a104b7e8526265baa760ca7db3c857d5e01ee1290dc6b4dc56802648bd522abf"}
Sep 10 14:45:04.088475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.088394    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a104b7e8526265baa760ca7db3c857d5e01ee1290dc6b4dc56802648bd522abf"
Sep 10 14:45:04.089815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.089797    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"
Sep 10 14:45:04.089920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.089843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp" event={"ID":"17c107aa-540c-480b-913c-7b078de3f0fe","Type":"ContainerDied","Data":"4b0d2edca45ca89bda08eb2aabe9620ce9459d1c386b8d8225f43df0b5f3f4b7"}
Sep 10 14:45:04.089920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:04.089880    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b0d2edca45ca89bda08eb2aabe9620ce9459d1c386b8d8225f43df0b5f3f4b7"
Sep 10 14:45:05.010916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:05.010880    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:45:17.998884 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:17.998847    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:45:17.999413 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:17.998900    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:45:19.256193 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:45:19.256154    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1036ad5b_beb8_434b_8caf_39596c48291b.slice/crio-c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1036ad5b_beb8_434b_8caf_39596c48291b.slice/crio-conmon-c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 14:45:20.207049 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:20.207016    2561 generic.go:356] "Generic (PLEG): container finished" podID="1036ad5b-beb8-434b-8caf-39596c48291b" containerID="c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e" exitCode=0
Sep 10 14:45:20.207259 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:20.207096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" event={"ID":"1036ad5b-beb8-434b-8caf-39596c48291b","Type":"ContainerDied","Data":"c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e"}
Sep 10 14:45:20.207640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:20.207622    2561 scope.go:117] "RemoveContainer" containerID="c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e"
Sep 10 14:45:20.211406 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:20.211368    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:20.211616 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:20.211585    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:20.211747 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:20.211656    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:21.215667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:21.215629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" event={"ID":"1036ad5b-beb8-434b-8caf-39596c48291b","Type":"ContainerStarted","Data":"5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7"}
Sep 10 14:45:21.271846 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:21.271800    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:45:21.272051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:21.271993    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:45:21.272154 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:21.272055    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 14:45:22.271949 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:22.271891    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:45:22.272419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:22.272029    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 14:45:23.271286 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.271251    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:45:23.271472 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.271319    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 14:45:23.816834 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.816794    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"]
Sep 10 14:45:23.817333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817320    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9ef369-4f0b-49c8-9e44-816c2f93afce" containerName="cleanup"
Sep 10 14:45:23.817378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817335    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9ef369-4f0b-49c8-9e44-816c2f93afce" containerName="cleanup"
Sep 10 14:45:23.817378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817345    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91bfac49-cc02-438f-8155-c702e0fd6019" containerName="cleanup"
Sep 10 14:45:23.817378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817350    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91bfac49-cc02-438f-8155-c702e0fd6019" containerName="cleanup"
Sep 10 14:45:23.817378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817361    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05bb995-9c0f-4836-a91c-f2be105e0729" containerName="cleanup"
Sep 10 14:45:23.817378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817367    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05bb995-9c0f-4836-a91c-f2be105e0729" containerName="cleanup"
Sep 10 14:45:23.817378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817378    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17c107aa-540c-480b-913c-7b078de3f0fe" containerName="cleanup"
Sep 10 14:45:23.817561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817384    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="17c107aa-540c-480b-913c-7b078de3f0fe" containerName="cleanup"
Sep 10 14:45:23.817561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817457    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91bfac49-cc02-438f-8155-c702e0fd6019" containerName="cleanup"
Sep 10 14:45:23.817561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817465    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b05bb995-9c0f-4836-a91c-f2be105e0729" containerName="cleanup"
Sep 10 14:45:23.817561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817477    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="17c107aa-540c-480b-913c-7b078de3f0fe" containerName="cleanup"
Sep 10 14:45:23.817561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.817484    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9ef369-4f0b-49c8-9e44-816c2f93afce" containerName="cleanup"
Sep 10 14:45:23.819791 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.819763    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"
Sep 10 14:45:23.824741 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.824697    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:45:23.832795 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.832657    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"]
Sep 10 14:45:23.969324 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:23.969274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4489c060-b899-4e6d-b719-7645cdc48e04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-785829b5-8d6jr\" (UID: \"4489c060-b899-4e6d-b719-7645cdc48e04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"
Sep 10 14:45:24.070538 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:24.070444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4489c060-b899-4e6d-b719-7645cdc48e04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-785829b5-8d6jr\" (UID: \"4489c060-b899-4e6d-b719-7645cdc48e04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"
Sep 10 14:45:24.071223 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:24.071202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4489c060-b899-4e6d-b719-7645cdc48e04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-785829b5-8d6jr\" (UID: \"4489c060-b899-4e6d-b719-7645cdc48e04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"
Sep 10 14:45:24.142954 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:24.142910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"
Sep 10 14:45:24.272357 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:24.272253    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:45:24.272800 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:24.272689    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 14:45:24.426965 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:45:24.426933    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4489c060_b899_4e6d_b719_7645cdc48e04.slice/crio-f3ffe6f07e622d61a2c72c80327fc6a16fd179dea6056ead68e89b0d8dfbfb84 WatchSource:0}: Error finding container f3ffe6f07e622d61a2c72c80327fc6a16fd179dea6056ead68e89b0d8dfbfb84: Status 404 returned error can't find the container with id f3ffe6f07e622d61a2c72c80327fc6a16fd179dea6056ead68e89b0d8dfbfb84
Sep 10 14:45:24.440027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:24.438287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"]
Sep 10 14:45:25.264628 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:25.264593    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr" event={"ID":"4489c060-b899-4e6d-b719-7645cdc48e04","Type":"ContainerStarted","Data":"4e9fd16080ce6b5ee19e44600c004f56d788111510ef093a6f693dd46717dc2c"}
Sep 10 14:45:25.265045 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:25.264646    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr" event={"ID":"4489c060-b899-4e6d-b719-7645cdc48e04","Type":"ContainerStarted","Data":"f3ffe6f07e622d61a2c72c80327fc6a16fd179dea6056ead68e89b0d8dfbfb84"}
Sep 10 14:45:25.272030 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:25.271944    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:45:25.272030 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:25.272016    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 14:45:25.282634 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:25.282585    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr" podStartSLOduration=2.28256821 podStartE2EDuration="2.28256821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:25.28211198 +0000 UTC m=+1039.746478502" watchObservedRunningTime="2026-09-10 14:45:25.28256821 +0000 UTC m=+1039.746934732"
Sep 10 14:45:26.271066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:26.271035    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:45:26.271561 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:26.271098    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 14:45:26.272932 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:26.272897    2561 generic.go:356] "Generic (PLEG): container finished" podID="4489c060-b899-4e6d-b719-7645cdc48e04" containerID="4e9fd16080ce6b5ee19e44600c004f56d788111510ef093a6f693dd46717dc2c" exitCode=0
Sep 10 14:45:26.273079 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:26.272934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr" event={"ID":"4489c060-b899-4e6d-b719-7645cdc48e04","Type":"ContainerDied","Data":"4e9fd16080ce6b5ee19e44600c004f56d788111510ef093a6f693dd46717dc2c"}
Sep 10 14:45:27.276110 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:27.276071    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:45:27.276669 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:27.276647    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:45:27.277377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:27.277355    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:45:27.449520 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:27.449491    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"
Sep 10 14:45:27.611784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:27.611645    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4489c060-b899-4e6d-b719-7645cdc48e04-maas-api-service-ca\") pod \"4489c060-b899-4e6d-b719-7645cdc48e04\" (UID: \"4489c060-b899-4e6d-b719-7645cdc48e04\") "
Sep 10 14:45:27.612085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:27.612061    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4489c060-b899-4e6d-b719-7645cdc48e04-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4489c060-b899-4e6d-b719-7645cdc48e04" (UID: "4489c060-b899-4e6d-b719-7645cdc48e04"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:45:27.612177 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:27.612164    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4489c060-b899-4e6d-b719-7645cdc48e04-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:28.287475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:28.287388    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"
Sep 10 14:45:28.287475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:28.287421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr" event={"ID":"4489c060-b899-4e6d-b719-7645cdc48e04","Type":"ContainerDied","Data":"f3ffe6f07e622d61a2c72c80327fc6a16fd179dea6056ead68e89b0d8dfbfb84"}
Sep 10 14:45:28.287475 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:28.287476    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3ffe6f07e622d61a2c72c80327fc6a16fd179dea6056ead68e89b0d8dfbfb84"
Sep 10 14:45:33.275391 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:33.275356    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"]
Sep 10 14:45:33.275851 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:33.275619    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy" containerID="cri-o://9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6" gracePeriod=30
Sep 10 14:45:34.019649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.019615    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"]
Sep 10 14:45:34.020145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.020131    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4489c060-b899-4e6d-b719-7645cdc48e04" containerName="revoke-keys"
Sep 10 14:45:34.020196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.020147    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4489c060-b899-4e6d-b719-7645cdc48e04" containerName="revoke-keys"
Sep 10 14:45:34.020252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.020243    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4489c060-b899-4e6d-b719-7645cdc48e04" containerName="revoke-keys"
Sep 10 14:45:34.022452 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.022428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.025396 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.025373    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-b20fba-openshift-default-dockercfg-ffbz8\""
Sep 10 14:45:34.036761 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.036729    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"]
Sep 10 14:45:34.192588 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.192541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-envoy\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.192588 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.192584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-credential-socket\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.192885 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.192674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-socket\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.192885 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.192768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-token\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.192885 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.192831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-certs\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.193007 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.192918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istiod-ca-cert\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.193007 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.192952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-data\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.193007 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.193001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-podinfo\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.193113 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.193029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zln\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-kube-api-access-22zln\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.294686 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-podinfo\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.294686 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22zln\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-kube-api-access-22zln\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-envoy\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-credential-socket\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-socket\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-token\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-certs\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.294989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istiod-ca-cert\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.295034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-data\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.295295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-certs\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.295324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-socket\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.295394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-credential-socket\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295648 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.295554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-data\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.295839 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.295821    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istiod-ca-cert\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.297645 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.297618    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-envoy\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.297841 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.297825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-podinfo\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.302997 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.302972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zln\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-kube-api-access-22zln\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.303174 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.303156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-token\") pod \"e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") " pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.336059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.336030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:34.414627 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.414585    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"]
Sep 10 14:45:34.417779 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.417683    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-785829b5-29817525-vc99g"]
Sep 10 14:45:34.443556 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.443514    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"]
Sep 10 14:45:34.443914 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.443854    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd" podUID="51b410e0-8472-49bd-9201-39fd1989c237" containerName="payload-processing" containerID="cri-o://2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c" gracePeriod=30
Sep 10 14:45:34.614821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.614775    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"]
Sep 10 14:45:34.618541 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.618509    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-785829b5-8d6jr"]
Sep 10 14:45:34.638231 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.638199    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"]
Sep 10 14:45:34.638745 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:45:34.638688    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9503f8_af00_48bd_b6b1_bfa6242b9d84.slice/crio-45e66f833c877c197e7ee5d3b3f5d49191cda8b8a3175a2427809ac10f19f05e WatchSource:0}: Error finding container 45e66f833c877c197e7ee5d3b3f5d49191cda8b8a3175a2427809ac10f19f05e: Status 404 returned error can't find the container with id 45e66f833c877c197e7ee5d3b3f5d49191cda8b8a3175a2427809ac10f19f05e
Sep 10 14:45:34.641765 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.641719    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:34.641887 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.641819    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:34.641887 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.641864    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:34.690212 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.690184    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:45:34.802722 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.801773    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51b410e0-8472-49bd-9201-39fd1989c237-plugins-config-volume\") pod \"51b410e0-8472-49bd-9201-39fd1989c237\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") "
Sep 10 14:45:34.802722 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.801871    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hj6r\" (UniqueName: \"kubernetes.io/projected/51b410e0-8472-49bd-9201-39fd1989c237-kube-api-access-5hj6r\") pod \"51b410e0-8472-49bd-9201-39fd1989c237\" (UID: \"51b410e0-8472-49bd-9201-39fd1989c237\") "
Sep 10 14:45:34.803402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.803361    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51b410e0-8472-49bd-9201-39fd1989c237-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51b410e0-8472-49bd-9201-39fd1989c237" (UID: "51b410e0-8472-49bd-9201-39fd1989c237"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:45:34.805226 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.805187    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b410e0-8472-49bd-9201-39fd1989c237-kube-api-access-5hj6r" (OuterVolumeSpecName: "kube-api-access-5hj6r") pod "51b410e0-8472-49bd-9201-39fd1989c237" (UID: "51b410e0-8472-49bd-9201-39fd1989c237"). InnerVolumeSpecName "kube-api-access-5hj6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:45:34.903509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.903457    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hj6r\" (UniqueName: \"kubernetes.io/projected/51b410e0-8472-49bd-9201-39fd1989c237-kube-api-access-5hj6r\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:34.903509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:34.903500    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51b410e0-8472-49bd-9201-39fd1989c237-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:35.335668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.335633    2561 generic.go:356] "Generic (PLEG): container finished" podID="51b410e0-8472-49bd-9201-39fd1989c237" containerID="2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c" exitCode=0
Sep 10 14:45:35.336164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.335668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd" event={"ID":"51b410e0-8472-49bd-9201-39fd1989c237","Type":"ContainerDied","Data":"2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c"}
Sep 10 14:45:35.336164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.335685    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"
Sep 10 14:45:35.336164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.335743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd" event={"ID":"51b410e0-8472-49bd-9201-39fd1989c237","Type":"ContainerDied","Data":"f21d566a756a616caa5cd9861c4f1a8d25cd697df9585bb17f06169cca17374f"}
Sep 10 14:45:35.336164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.335772    2561 scope.go:117] "RemoveContainer" containerID="2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c"
Sep 10 14:45:35.337770 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.337743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c" event={"ID":"5a9503f8-af00-48bd-b6b1-bfa6242b9d84","Type":"ContainerStarted","Data":"b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5"}
Sep 10 14:45:35.337897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.337796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c" event={"ID":"5a9503f8-af00-48bd-b6b1-bfa6242b9d84","Type":"ContainerStarted","Data":"45e66f833c877c197e7ee5d3b3f5d49191cda8b8a3175a2427809ac10f19f05e"}
Sep 10 14:45:35.356551 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.356353    2561 scope.go:117] "RemoveContainer" containerID="2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c"
Sep 10 14:45:35.356720 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:45:35.356678    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c\": container with ID starting with 2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c not found: ID does not exist" containerID="2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c"
Sep 10 14:45:35.356778 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.356729    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c"} err="failed to get container status \"2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c\": rpc error: code = NotFound desc = could not find container \"2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c\": container with ID starting with 2ce596dcc749f354d18547f474553a512b54c0ce87c3de3f6861d4c71e200e9c not found: ID does not exist"
Sep 10 14:45:35.365166 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.365104    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c" podStartSLOduration=2.365084787 podStartE2EDuration="2.365084787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:35.362483848 +0000 UTC m=+1049.826850372" watchObservedRunningTime="2026-09-10 14:45:35.365084787 +0000 UTC m=+1049.829451311"
Sep 10 14:45:35.377284 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.377256    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"]
Sep 10 14:45:35.379711 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.379669    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-785829b5-5d6c496f8f-mtxfd"]
Sep 10 14:45:35.996194 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.996159    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4489c060-b899-4e6d-b719-7645cdc48e04" path="/var/lib/kubelet/pods/4489c060-b899-4e6d-b719-7645cdc48e04/volumes"
Sep 10 14:45:35.996542 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.996528    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51b410e0-8472-49bd-9201-39fd1989c237" path="/var/lib/kubelet/pods/51b410e0-8472-49bd-9201-39fd1989c237/volumes"
Sep 10 14:45:35.996829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:35.996815    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91bfac49-cc02-438f-8155-c702e0fd6019" path="/var/lib/kubelet/pods/91bfac49-cc02-438f-8155-c702e0fd6019/volumes"
Sep 10 14:45:36.337210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:36.337126    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:36.343194 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:36.343168    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:36.355426 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:36.355394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:36.356553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:36.356527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:45:38.541060 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.540998    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:45:38.647169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-certs\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647367 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647177    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-socket\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647367 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647246    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-data\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647367 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647270    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-istio-token\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647367 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647314    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-envoy\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647389    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d627eea-7638-415c-87c7-998e6b46197c-istiod-ca-cert\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-credential-socket\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647466    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwt76\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-kube-api-access-mwt76\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.647661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647493    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d627eea-7638-415c-87c7-998e6b46197c-istio-podinfo\") pod \"5d627eea-7638-415c-87c7-998e6b46197c\" (UID: \"5d627eea-7638-415c-87c7-998e6b46197c\") "
Sep 10 14:45:38.648359 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647484    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:38.648359 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:38.648359 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.647901    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:38.648359 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.648309    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:38.648359 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.648314    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d627eea-7638-415c-87c7-998e6b46197c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:45:38.650283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.650250    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d627eea-7638-415c-87c7-998e6b46197c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:45:38.650283 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.650269    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-kube-api-access-mwt76" (OuterVolumeSpecName: "kube-api-access-mwt76") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "kube-api-access-mwt76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:45:38.650454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.650319    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:38.650454 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.650329    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d627eea-7638-415c-87c7-998e6b46197c" (UID: "5d627eea-7638-415c-87c7-998e6b46197c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:45:38.748972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.748935    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.748972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.748966    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.748972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.748976    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.748972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.748984    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.749248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.748993    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.749248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.749000    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d627eea-7638-415c-87c7-998e6b46197c-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.749248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.749008    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d627eea-7638-415c-87c7-998e6b46197c-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.749248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.749016    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwt76\" (UniqueName: \"kubernetes.io/projected/5d627eea-7638-415c-87c7-998e6b46197c-kube-api-access-mwt76\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:38.749248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:38.749025    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d627eea-7638-415c-87c7-998e6b46197c-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:39.375907 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.375872    2561 generic.go:356] "Generic (PLEG): container finished" podID="5d627eea-7638-415c-87c7-998e6b46197c" containerID="9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6" exitCode=0
Sep 10 14:45:39.376101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.375980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" event={"ID":"5d627eea-7638-415c-87c7-998e6b46197c","Type":"ContainerDied","Data":"9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6"}
Sep 10 14:45:39.376101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.375983    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"
Sep 10 14:45:39.376101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.376023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv" event={"ID":"5d627eea-7638-415c-87c7-998e6b46197c","Type":"ContainerDied","Data":"4142c29b208102256831a902f5ab85ccea1fcec4fb526c35b88222d46c9167b7"}
Sep 10 14:45:39.376101 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.376045    2561 scope.go:117] "RemoveContainer" containerID="9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6"
Sep 10 14:45:39.386275 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.386252    2561 scope.go:117] "RemoveContainer" containerID="a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798"
Sep 10 14:45:39.395540 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.395516    2561 scope.go:117] "RemoveContainer" containerID="9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6"
Sep 10 14:45:39.396562 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:45:39.396411    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6\": container with ID starting with 9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6 not found: ID does not exist" containerID="9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6"
Sep 10 14:45:39.396562 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.396455    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6"} err="failed to get container status \"9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6\": rpc error: code = NotFound desc = could not find container \"9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6\": container with ID starting with 9b39ec928ca08f6e5d32f07377f88e2989d50c01d2286b96cf2e4260e39ddde6 not found: ID does not exist"
Sep 10 14:45:39.396562 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.396483    2561 scope.go:117] "RemoveContainer" containerID="a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798"
Sep 10 14:45:39.400732 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:45:39.397381    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798\": container with ID starting with a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798 not found: ID does not exist" containerID="a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798"
Sep 10 14:45:39.400732 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.397429    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798"} err="failed to get container status \"a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798\": rpc error: code = NotFound desc = could not find container \"a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798\": container with ID starting with a7cead1d325693afd788ccb3bdee681b8adf43943a7b9c508ad0ce87f6781798 not found: ID does not exist"
Sep 10 14:45:39.401435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.401330    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"]
Sep 10 14:45:39.404020 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.403998    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c072e8-openshift-default-5489db59b-vwmpv"]
Sep 10 14:45:39.994715 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:39.994661    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d627eea-7638-415c-87c7-998e6b46197c" path="/var/lib/kubelet/pods/5d627eea-7638-415c-87c7-998e6b46197c/volumes"
Sep 10 14:45:40.844222 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:40.844180    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"]
Sep 10 14:45:40.844534 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:40.844478    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" containerID="cri-o://5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7" gracePeriod=30
Sep 10 14:45:42.278716 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:42.278657    2561 patch_prober.go:28] interesting pod/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 14:45:42.279098 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:42.278791    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:45:46.093663 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.093635    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:45:46.129479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129403    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-istio-token\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129628 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129490    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vksmt\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-kube-api-access-vksmt\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129628 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129534    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-socket\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129628 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1036ad5b-beb8-434b-8caf-39596c48291b-istio-podinfo\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129628 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129609    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-data\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1036ad5b-beb8-434b-8caf-39596c48291b-istiod-ca-cert\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129757    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-credential-socket\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129784    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-certs\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.129867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-envoy\") pod \"1036ad5b-beb8-434b-8caf-39596c48291b\" (UID: \"1036ad5b-beb8-434b-8caf-39596c48291b\") "
Sep 10 14:45:46.130062 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.129917    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130145    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130176    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1036ad5b-beb8-434b-8caf-39596c48291b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130373    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-data" (OuterVolumeSpecName: "istio-data") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130531    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130552    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130566    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1036ad5b-beb8-434b-8caf-39596c48291b-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130579    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.130630 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.130595    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.132367 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.132338    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-kube-api-access-vksmt" (OuterVolumeSpecName: "kube-api-access-vksmt") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "kube-api-access-vksmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:45:46.132478 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.132419    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:45:46.132635 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.132613    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1036ad5b-beb8-434b-8caf-39596c48291b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:45:46.133061 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.133037    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-istio-token" (OuterVolumeSpecName: "istio-token") pod "1036ad5b-beb8-434b-8caf-39596c48291b" (UID: "1036ad5b-beb8-434b-8caf-39596c48291b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:45:46.231409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.231356    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.231409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.231405    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vksmt\" (UniqueName: \"kubernetes.io/projected/1036ad5b-beb8-434b-8caf-39596c48291b-kube-api-access-vksmt\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.231409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.231418    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1036ad5b-beb8-434b-8caf-39596c48291b-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.231409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.231427    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1036ad5b-beb8-434b-8caf-39596c48291b-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:45:46.422796 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.422764    2561 generic.go:356] "Generic (PLEG): container finished" podID="1036ad5b-beb8-434b-8caf-39596c48291b" containerID="5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7" exitCode=0
Sep 10 14:45:46.423009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.422817    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"
Sep 10 14:45:46.423009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.422836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" event={"ID":"1036ad5b-beb8-434b-8caf-39596c48291b","Type":"ContainerDied","Data":"5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7"}
Sep 10 14:45:46.423009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.422887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq" event={"ID":"1036ad5b-beb8-434b-8caf-39596c48291b","Type":"ContainerDied","Data":"fd582355c5f863669dcc28eb3b11b098733a6a5338a681fb911290ad5ea36500"}
Sep 10 14:45:46.423009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.422916    2561 scope.go:117] "RemoveContainer" containerID="5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7"
Sep 10 14:45:46.435093 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.435073    2561 scope.go:117] "RemoveContainer" containerID="c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e"
Sep 10 14:45:46.444671 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.444650    2561 scope.go:117] "RemoveContainer" containerID="5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7"
Sep 10 14:45:46.445042 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:45:46.445018    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7\": container with ID starting with 5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7 not found: ID does not exist" containerID="5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7"
Sep 10 14:45:46.445095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.445058    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7"} err="failed to get container status \"5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7\": rpc error: code = NotFound desc = could not find container \"5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7\": container with ID starting with 5542ae39a3ab6b5a7e4bfd845938315a2739bd0d4d7be3b2ea482d42841b96d7 not found: ID does not exist"
Sep 10 14:45:46.445095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.445083    2561 scope.go:117] "RemoveContainer" containerID="c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e"
Sep 10 14:45:46.445407 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:45:46.445388    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e\": container with ID starting with c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e not found: ID does not exist" containerID="c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e"
Sep 10 14:45:46.445503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.445412    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e"} err="failed to get container status \"c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e\": rpc error: code = NotFound desc = could not find container \"c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e\": container with ID starting with c19f220ef13e08081d987dc81a6be268646f1d6b3667a817266bdee1011d8e5e not found: ID does not exist"
Sep 10 14:45:46.447559 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.447536    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"]
Sep 10 14:45:46.450404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:46.450384    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-785829b5-openshift-default-67b8cdf864-jw7gq"]
Sep 10 14:45:47.995140 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:47.995104    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" path="/var/lib/kubelet/pods/1036ad5b-beb8-434b-8caf-39596c48291b/volumes"
Sep 10 14:45:54.770691 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.770648    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"]
Sep 10 14:45:54.771320 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771294    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy"
Sep 10 14:45:54.771419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771322    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy"
Sep 10 14:45:54.771419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771352    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy"
Sep 10 14:45:54.771419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771361    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy"
Sep 10 14:45:54.771419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771403    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b410e0-8472-49bd-9201-39fd1989c237" containerName="payload-processing"
Sep 10 14:45:54.771419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771412    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b410e0-8472-49bd-9201-39fd1989c237" containerName="payload-processing"
Sep 10 14:45:54.771587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771514    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy"
Sep 10 14:45:54.771587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771527    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy"
Sep 10 14:45:54.771587 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.771539    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b410e0-8472-49bd-9201-39fd1989c237" containerName="payload-processing"
Sep 10 14:45:54.775329 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.775304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.778190 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.778154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-5c9641-openshift-default-dockercfg-cpxsk\""
Sep 10 14:45:54.791041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.791003    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"]
Sep 10 14:45:54.930733 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.930659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-token\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.930944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.930796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-data\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.930944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.930868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-socket\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.931030 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.930967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-certs\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.931030 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.931018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-credential-socket\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.931100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.931042    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istiod-ca-cert\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.931135 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.931113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-podinfo\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.931170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.931142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfhg\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-kube-api-access-hqfhg\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:54.931223 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:54.931205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-envoy\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.031911 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.031808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-socket\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.031911 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.031852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-certs\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.031911 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.031870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-credential-socket\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istiod-ca-cert\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-podinfo\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfhg\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-kube-api-access-hqfhg\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-credential-socket\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-envoy\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-socket\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-certs\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-token\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-data\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032750 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-data\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.032810 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.032751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istiod-ca-cert\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.035080 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.035055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-envoy\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.035206 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.035179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-podinfo\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.040830 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.040805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-token\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.041081 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.041061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfhg\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-kube-api-access-hqfhg\") pod \"e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") " pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.087042 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.087001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:55.376332 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.376301    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"]
Sep 10 14:45:55.378094 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:45:55.378067    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae10dc3_a30e_4456_ba9d_fb4fb1420d8e.slice/crio-abac69d9a3728d0daa896345e41ececef14aee63b0d9a388c6565ef7bc8795db WatchSource:0}: Error finding container abac69d9a3728d0daa896345e41ececef14aee63b0d9a388c6565ef7bc8795db: Status 404 returned error can't find the container with id abac69d9a3728d0daa896345e41ececef14aee63b0d9a388c6565ef7bc8795db
Sep 10 14:45:55.380665 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.380628    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:55.380751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.380716    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:55.380798 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.380752    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:45:55.484574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.484532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" event={"ID":"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e","Type":"ContainerStarted","Data":"fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd"}
Sep 10 14:45:55.484784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.484599    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" event={"ID":"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e","Type":"ContainerStarted","Data":"abac69d9a3728d0daa896345e41ececef14aee63b0d9a388c6565ef7bc8795db"}
Sep 10 14:45:55.506776 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:55.506695    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podStartSLOduration=1.506667969 podStartE2EDuration="1.506667969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:55.503697155 +0000 UTC m=+1069.968063678" watchObservedRunningTime="2026-09-10 14:45:55.506667969 +0000 UTC m=+1069.971034490"
Sep 10 14:45:56.087429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:56.087387    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:56.093081 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:56.093056    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:56.490794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:56.490761    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:45:56.491700 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:45:56.491683    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:46:12.208242 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.208207    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"]
Sep 10 14:46:12.208932 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.208910    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy"
Sep 10 14:46:12.209036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.208933    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy"
Sep 10 14:46:12.209036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.208986    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy"
Sep 10 14:46:12.209036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.208996    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy"
Sep 10 14:46:12.209193 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.209111    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d627eea-7638-415c-87c7-998e6b46197c" containerName="istio-proxy"
Sep 10 14:46:12.209193 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.209127    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1036ad5b-beb8-434b-8caf-39596c48291b" containerName="istio-proxy"
Sep 10 14:46:12.213932 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.213904    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"
Sep 10 14:46:12.216640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.216610    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:46:12.218838 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.218812    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"]
Sep 10 14:46:12.354514 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.354477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb92188-112a-4dcf-8f37-9ef78af9c3d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp\" (UID: \"abb92188-112a-4dcf-8f37-9ef78af9c3d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"
Sep 10 14:46:12.455500 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.455459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb92188-112a-4dcf-8f37-9ef78af9c3d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp\" (UID: \"abb92188-112a-4dcf-8f37-9ef78af9c3d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"
Sep 10 14:46:12.456190 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.456157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb92188-112a-4dcf-8f37-9ef78af9c3d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp\" (UID: \"abb92188-112a-4dcf-8f37-9ef78af9c3d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"
Sep 10 14:46:12.559266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.559229    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"
Sep 10 14:46:12.833837 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:12.833803    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"]
Sep 10 14:46:12.834788 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:46:12.834761    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb92188_112a_4dcf_8f37_9ef78af9c3d0.slice/crio-420ed55b737706c891785ea9e119174b9f453434cfdf2b9b5721bd5ba4b42f37 WatchSource:0}: Error finding container 420ed55b737706c891785ea9e119174b9f453434cfdf2b9b5721bd5ba4b42f37: Status 404 returned error can't find the container with id 420ed55b737706c891785ea9e119174b9f453434cfdf2b9b5721bd5ba4b42f37
Sep 10 14:46:13.607307 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:13.607266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp" event={"ID":"abb92188-112a-4dcf-8f37-9ef78af9c3d0","Type":"ContainerStarted","Data":"4938a650bf1239340fdea5f43f46f681674e0bdf6da3539236b3d492c0e4565a"}
Sep 10 14:46:13.607786 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:13.607329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp" event={"ID":"abb92188-112a-4dcf-8f37-9ef78af9c3d0","Type":"ContainerStarted","Data":"420ed55b737706c891785ea9e119174b9f453434cfdf2b9b5721bd5ba4b42f37"}
Sep 10 14:46:13.622036 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:13.621980    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp" podStartSLOduration=1.621960163 podStartE2EDuration="1.621960163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:46:13.621304234 +0000 UTC m=+1088.085670757" watchObservedRunningTime="2026-09-10 14:46:13.621960163 +0000 UTC m=+1088.086326685"
Sep 10 14:46:14.617887 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:14.617846    2561 generic.go:356] "Generic (PLEG): container finished" podID="abb92188-112a-4dcf-8f37-9ef78af9c3d0" containerID="4938a650bf1239340fdea5f43f46f681674e0bdf6da3539236b3d492c0e4565a" exitCode=0
Sep 10 14:46:14.618273 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:14.617945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp" event={"ID":"abb92188-112a-4dcf-8f37-9ef78af9c3d0","Type":"ContainerDied","Data":"4938a650bf1239340fdea5f43f46f681674e0bdf6da3539236b3d492c0e4565a"}
Sep 10 14:46:15.770125 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:15.770099    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"
Sep 10 14:46:15.895031 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:15.894936    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb92188-112a-4dcf-8f37-9ef78af9c3d0-maas-api-service-ca\") pod \"abb92188-112a-4dcf-8f37-9ef78af9c3d0\" (UID: \"abb92188-112a-4dcf-8f37-9ef78af9c3d0\") "
Sep 10 14:46:15.895373 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:15.895348    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb92188-112a-4dcf-8f37-9ef78af9c3d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "abb92188-112a-4dcf-8f37-9ef78af9c3d0" (UID: "abb92188-112a-4dcf-8f37-9ef78af9c3d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:15.895468 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:15.895451    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb92188-112a-4dcf-8f37-9ef78af9c3d0-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:16.633155 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.633118    2561 generic.go:356] "Generic (PLEG): container finished" podID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerID="fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd" exitCode=0
Sep 10 14:46:16.633435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.633196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" event={"ID":"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e","Type":"ContainerDied","Data":"fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd"}
Sep 10 14:46:16.633783 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.633759    2561 scope.go:117] "RemoveContainer" containerID="fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd"
Sep 10 14:46:16.634999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.634978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp" event={"ID":"abb92188-112a-4dcf-8f37-9ef78af9c3d0","Type":"ContainerDied","Data":"420ed55b737706c891785ea9e119174b9f453434cfdf2b9b5721bd5ba4b42f37"}
Sep 10 14:46:16.634999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.634994    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"
Sep 10 14:46:16.635156 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.635024    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="420ed55b737706c891785ea9e119174b9f453434cfdf2b9b5721bd5ba4b42f37"
Sep 10 14:46:16.635196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.635161    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:16.635262 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.635245    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:16.635313 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:16.635296    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:17.649975 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:17.649920    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" event={"ID":"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e","Type":"ContainerStarted","Data":"43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490"}
Sep 10 14:46:18.087481 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.087376    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:46:18.087644 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.087613    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:46:18.087772 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.087670    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 10 14:46:18.927482 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.927437    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"]
Sep 10 14:46:18.928299 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.928272    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb92188-112a-4dcf-8f37-9ef78af9c3d0" containerName="revoke-keys"
Sep 10 14:46:18.928299 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.928300    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb92188-112a-4dcf-8f37-9ef78af9c3d0" containerName="revoke-keys"
Sep 10 14:46:18.928503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.928420    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb92188-112a-4dcf-8f37-9ef78af9c3d0" containerName="revoke-keys"
Sep 10 14:46:18.931072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.931048    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:18.934857 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.934829    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b0323\"/\"distinct-2-w4-5b0323-kserve-self-signed-certs\""
Sep 10 14:46:18.945898 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:18.944693    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"]
Sep 10 14:46:19.034738 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.034539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tls-certs\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.034955 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.034837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-dshm\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.034955 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.034917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h8k9\" (UniqueName: \"kubernetes.io/projected/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-kube-api-access-9h8k9\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.035097 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.034973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tmp-dir\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.035097 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.035012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-model-cache\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.035097 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.035053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-home\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.088043 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.088000    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:46:19.088223 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.088068    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 10 14:46:19.136169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-home\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.136390 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tls-certs\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.136390 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-dshm\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.136523 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h8k9\" (UniqueName: \"kubernetes.io/projected/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-kube-api-access-9h8k9\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.136523 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tmp-dir\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.136523 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-model-cache\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.136692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-home\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.136868 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.136844    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-model-cache\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.137498 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.137469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tmp-dir\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.140257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.140226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tls-certs\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.148730 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.147474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h8k9\" (UniqueName: \"kubernetes.io/projected/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-kube-api-access-9h8k9\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.150069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.150041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-dshm\") pod \"distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") " pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.246784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.246652    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:19.554043 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.554004    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"]
Sep 10 14:46:19.556495 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:46:19.556456    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod623af7eb_cd43_4fc2_8b09_e2b9bbecb1c0.slice/crio-1382c97f38f73ae2063a213047a3012a496fd084b8054057a986b02dc29f05b4 WatchSource:0}: Error finding container 1382c97f38f73ae2063a213047a3012a496fd084b8054057a986b02dc29f05b4: Status 404 returned error can't find the container with id 1382c97f38f73ae2063a213047a3012a496fd084b8054057a986b02dc29f05b4
Sep 10 14:46:19.665471 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.665431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2" event={"ID":"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0","Type":"ContainerStarted","Data":"5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60"}
Sep 10 14:46:19.665471 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.665478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2" event={"ID":"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0","Type":"ContainerStarted","Data":"1382c97f38f73ae2063a213047a3012a496fd084b8054057a986b02dc29f05b4"}
Sep 10 14:46:19.685757 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:19.685684    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2" podStartSLOduration=1.6856663539999999 podStartE2EDuration="1.685666354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:46:19.682517332 +0000 UTC m=+1094.146883878" watchObservedRunningTime="2026-09-10 14:46:19.685666354 +0000 UTC m=+1094.150032875"
Sep 10 14:46:20.087791 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:20.087749    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:46:20.088189 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:20.087830    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 10 14:46:21.088429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:21.088387    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:46:21.088954 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:21.088473    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 10 14:46:22.087833 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:22.087790    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:46:22.088027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:22.087851    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 10 14:46:23.052594 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.052551    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"]
Sep 10 14:46:23.055583 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.055557    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.058489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.058460    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-ecfa25-openshift-default-dockercfg-rj248\""
Sep 10 14:46:23.073018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.072984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"]
Sep 10 14:46:23.095760 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.094990    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:46:23.095760 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.095606    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:46:23.097230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.097206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:46:23.105102 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105065    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-socket\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105370 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-podinfo\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105503 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-data\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-certs\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105648 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-credential-socket\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105724 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-token\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105842 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94582bc-a5a5-4b7d-860c-846716ae30ec-istiod-ca-cert\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brgbg\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-kube-api-access-brgbg\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.105964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.105895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-envoy\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.186802 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.186767    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"]
Sep 10 14:46:23.192111 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.192080    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5121f4-29817525-ts8cp"]
Sep 10 14:46:23.207627 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.207589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-socket\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.207627 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.207630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-podinfo\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.207916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.207662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-data\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.207916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.207743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-certs\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.207916 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.207886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-credential-socket\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208131 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-token\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208205 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-data\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208273 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-certs\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94582bc-a5a5-4b7d-860c-846716ae30ec-istiod-ca-cert\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208387 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgbg\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-kube-api-access-brgbg\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208387 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-envoy\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-credential-socket\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.208654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-socket\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.209014 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.208984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94582bc-a5a5-4b7d-860c-846716ae30ec-istiod-ca-cert\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.210447 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.210416    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-podinfo\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.210563 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.210505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-envoy\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.223856 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.223825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-token\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.225768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.225741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgbg\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-kube-api-access-brgbg\") pod \"e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") " pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.294766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.294726    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"]
Sep 10 14:46:23.294962 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.294939    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4" podUID="48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" containerName="payload-pre-processing" containerID="cri-o://c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e" gracePeriod=30
Sep 10 14:46:23.371445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.371408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:23.470566 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.470525    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"]
Sep 10 14:46:23.473296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.473266    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5121f4-ws2vp"]
Sep 10 14:46:23.606116 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.606089    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:46:23.664037 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.663992    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"]
Sep 10 14:46:23.664327 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:46:23.664304    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94582bc_a5a5_4b7d_860c_846716ae30ec.slice/crio-16cb39222c04a17c4a19ca83e9c8f3872fba89e95a498546d5a1a9edc86e92a2 WatchSource:0}: Error finding container 16cb39222c04a17c4a19ca83e9c8f3872fba89e95a498546d5a1a9edc86e92a2: Status 404 returned error can't find the container with id 16cb39222c04a17c4a19ca83e9c8f3872fba89e95a498546d5a1a9edc86e92a2
Sep 10 14:46:23.666986 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.666947    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:23.667086 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.667023    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:23.667086 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.667053    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:23.693045 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.693015    2561 generic.go:356] "Generic (PLEG): container finished" podID="48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" containerID="c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e" exitCode=0
Sep 10 14:46:23.693209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.693072    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"
Sep 10 14:46:23.693209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.693097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4" event={"ID":"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160","Type":"ContainerDied","Data":"c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e"}
Sep 10 14:46:23.693209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.693159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4" event={"ID":"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160","Type":"ContainerDied","Data":"c1d6dfda22669a3b608762ec5b57bf58320396aeba54d24cdc2e62745ece34b4"}
Sep 10 14:46:23.693209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.693188    2561 scope.go:117] "RemoveContainer" containerID="c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e"
Sep 10 14:46:23.694519 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.694494    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" event={"ID":"f94582bc-a5a5-4b7d-860c-846716ae30ec","Type":"ContainerStarted","Data":"16cb39222c04a17c4a19ca83e9c8f3872fba89e95a498546d5a1a9edc86e92a2"}
Sep 10 14:46:23.705666 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.705636    2561 scope.go:117] "RemoveContainer" containerID="c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e"
Sep 10 14:46:23.706117 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:46:23.706095    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e\": container with ID starting with c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e not found: ID does not exist" containerID="c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e"
Sep 10 14:46:23.706182 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.706129    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e"} err="failed to get container status \"c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e\": rpc error: code = NotFound desc = could not find container \"c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e\": container with ID starting with c9897e9a949a0e6db29b69f1df33367f4b54c9fa23669648632eaafeae0d3b1e not found: ID does not exist"
Sep 10 14:46:23.717371 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.717341    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-plugins-config-volume\") pod \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") "
Sep 10 14:46:23.717547 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.717460    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txhsf\" (UniqueName: \"kubernetes.io/projected/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-kube-api-access-txhsf\") pod \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\" (UID: \"48d0ff71-1f88-40a5-9b2d-2f2c5cf46160\") "
Sep 10 14:46:23.717828 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.717796    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" (UID: "48d0ff71-1f88-40a5-9b2d-2f2c5cf46160"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:23.719456 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.719420    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-kube-api-access-txhsf" (OuterVolumeSpecName: "kube-api-access-txhsf") pod "48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" (UID: "48d0ff71-1f88-40a5-9b2d-2f2c5cf46160"). InnerVolumeSpecName "kube-api-access-txhsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:46:23.819031 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.818992    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txhsf\" (UniqueName: \"kubernetes.io/projected/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-kube-api-access-txhsf\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:23.819031 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.819029    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:23.995611 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.995572    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17c107aa-540c-480b-913c-7b078de3f0fe" path="/var/lib/kubelet/pods/17c107aa-540c-480b-913c-7b078de3f0fe/volumes"
Sep 10 14:46:23.995989 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:23.995971    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb92188-112a-4dcf-8f37-9ef78af9c3d0" path="/var/lib/kubelet/pods/abb92188-112a-4dcf-8f37-9ef78af9c3d0/volumes"
Sep 10 14:46:24.020386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:24.020346    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"]
Sep 10 14:46:24.024451 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:24.024413    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-5121f4-76998ff8b-98wb4"]
Sep 10 14:46:24.703229 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:24.703190    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" event={"ID":"f94582bc-a5a5-4b7d-860c-846716ae30ec","Type":"ContainerStarted","Data":"855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641"}
Sep 10 14:46:24.727375 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:24.727314    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podStartSLOduration=1.7272951 podStartE2EDuration="1.7272951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:46:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:46:24.724477221 +0000 UTC m=+1099.188843771" watchObservedRunningTime="2026-09-10 14:46:24.7272951 +0000 UTC m=+1099.191661619"
Sep 10 14:46:25.372500 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:25.372457    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:25.377762 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:25.377724    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:25.710129 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:25.710095    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:25.711077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:25.711051    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:25.998173 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:25.998073    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" path="/var/lib/kubelet/pods/48d0ff71-1f88-40a5-9b2d-2f2c5cf46160/volumes"
Sep 10 14:46:28.831371 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.831332    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"]
Sep 10 14:46:28.831886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.831870    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" containerName="payload-pre-processing"
Sep 10 14:46:28.831940 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.831888    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" containerName="payload-pre-processing"
Sep 10 14:46:28.831973 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.831967    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="48d0ff71-1f88-40a5-9b2d-2f2c5cf46160" containerName="payload-pre-processing"
Sep 10 14:46:28.835658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.835639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:28.838166 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.838135    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-ecfa25-dockercfg-h7lsw\""
Sep 10 14:46:28.838544 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.838529    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-ecfa25\""
Sep 10 14:46:28.844416 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.844388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"]
Sep 10 14:46:28.904670 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.904620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27d482c-e327-431b-ba22-d89f841e5a50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:28.904890 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:28.904764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls8w5\" (UniqueName: \"kubernetes.io/projected/b27d482c-e327-431b-ba22-d89f841e5a50-kube-api-access-ls8w5\") pod \"payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:29.006522 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.006482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27d482c-e327-431b-ba22-d89f841e5a50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:29.006765 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.006558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls8w5\" (UniqueName: \"kubernetes.io/projected/b27d482c-e327-431b-ba22-d89f841e5a50-kube-api-access-ls8w5\") pod \"payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:29.007278 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.007260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27d482c-e327-431b-ba22-d89f841e5a50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:29.015166 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.015130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls8w5\" (UniqueName: \"kubernetes.io/projected/b27d482c-e327-431b-ba22-d89f841e5a50-kube-api-access-ls8w5\") pod \"payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:29.148514 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.148477    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:29.247102 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.247070    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:29.247263 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.247118    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:29.261004 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.260973    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:29.451720 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:46:29.451674    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27d482c_e327_431b_ba22_d89f841e5a50.slice/crio-0e0b2c12ccd179d62b41e89163c80449fc7d75bef0b40ad2d3106365e32b28ac WatchSource:0}: Error finding container 0e0b2c12ccd179d62b41e89163c80449fc7d75bef0b40ad2d3106365e32b28ac: Status 404 returned error can't find the container with id 0e0b2c12ccd179d62b41e89163c80449fc7d75bef0b40ad2d3106365e32b28ac
Sep 10 14:46:29.451945 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.451919    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"]
Sep 10 14:46:29.742518 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.742417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf" event={"ID":"b27d482c-e327-431b-ba22-d89f841e5a50","Type":"ContainerStarted","Data":"985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f"}
Sep 10 14:46:29.742518 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.742486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf" event={"ID":"b27d482c-e327-431b-ba22-d89f841e5a50","Type":"ContainerStarted","Data":"0e0b2c12ccd179d62b41e89163c80449fc7d75bef0b40ad2d3106365e32b28ac"}
Sep 10 14:46:29.742518 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.742518    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:29.755926 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.755886    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:46:29.760486 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:29.760423    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf" podStartSLOduration=1.760400873 podStartE2EDuration="1.760400873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:46:29.758997524 +0000 UTC m=+1104.223364061" watchObservedRunningTime="2026-09-10 14:46:29.760400873 +0000 UTC m=+1104.224767413"
Sep 10 14:46:30.226779 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.226744    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"]
Sep 10 14:46:30.227210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.227003    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" containerID="cri-o://e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee" gracePeriod=30
Sep 10 14:46:30.562730 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.562612    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"]
Sep 10 14:46:30.567495 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.567472    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"
Sep 10 14:46:30.570499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.570465    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:46:30.573277 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.573243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"]
Sep 10 14:46:30.735476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.735437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c278aeb-6cf3-4ea5-b45f-c874e0f356e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf\" (UID: \"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"
Sep 10 14:46:30.836894 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.836793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c278aeb-6cf3-4ea5-b45f-c874e0f356e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf\" (UID: \"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"
Sep 10 14:46:30.837430 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.837403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c278aeb-6cf3-4ea5-b45f-c874e0f356e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf\" (UID: \"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"
Sep 10 14:46:30.881252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:30.881209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"
Sep 10 14:46:31.159130 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:31.159100    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"]
Sep 10 14:46:31.160279 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:46:31.160247    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c278aeb_6cf3_4ea5_b45f_c874e0f356e5.slice/crio-b1f2bd61c6bbcb7596accf3bd806c8338a78a8e7bcfdf69aea8222f979696bb7 WatchSource:0}: Error finding container b1f2bd61c6bbcb7596accf3bd806c8338a78a8e7bcfdf69aea8222f979696bb7: Status 404 returned error can't find the container with id b1f2bd61c6bbcb7596accf3bd806c8338a78a8e7bcfdf69aea8222f979696bb7
Sep 10 14:46:31.758402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:31.758274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf" event={"ID":"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5","Type":"ContainerStarted","Data":"971b59031194f7550e0ddee8f00172cf9952ed92d3da9c18415b2d552de901d0"}
Sep 10 14:46:31.758402 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:31.758368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf" event={"ID":"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5","Type":"ContainerStarted","Data":"b1f2bd61c6bbcb7596accf3bd806c8338a78a8e7bcfdf69aea8222f979696bb7"}
Sep 10 14:46:31.775425 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:31.775361    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf" podStartSLOduration=1.775339564 podStartE2EDuration="1.775339564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:46:31.773233227 +0000 UTC m=+1106.237599753" watchObservedRunningTime="2026-09-10 14:46:31.775339564 +0000 UTC m=+1106.239706088"
Sep 10 14:46:32.768079 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:32.768040    2561 generic.go:356] "Generic (PLEG): container finished" podID="9c278aeb-6cf3-4ea5-b45f-c874e0f356e5" containerID="971b59031194f7550e0ddee8f00172cf9952ed92d3da9c18415b2d552de901d0" exitCode=0
Sep 10 14:46:32.768474 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:32.768124    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf" event={"ID":"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5","Type":"ContainerDied","Data":"971b59031194f7550e0ddee8f00172cf9952ed92d3da9c18415b2d552de901d0"}
Sep 10 14:46:33.925386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:33.925359    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"
Sep 10 14:46:34.075465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.075352    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c278aeb-6cf3-4ea5-b45f-c874e0f356e5-maas-api-service-ca\") pod \"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5\" (UID: \"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5\") "
Sep 10 14:46:34.075751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.075729    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c278aeb-6cf3-4ea5-b45f-c874e0f356e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c278aeb-6cf3-4ea5-b45f-c874e0f356e5" (UID: "9c278aeb-6cf3-4ea5-b45f-c874e0f356e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:34.176953 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.176909    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c278aeb-6cf3-4ea5-b45f-c874e0f356e5-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:34.784920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.784885    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"
Sep 10 14:46:34.784920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.784912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf" event={"ID":"9c278aeb-6cf3-4ea5-b45f-c874e0f356e5","Type":"ContainerDied","Data":"b1f2bd61c6bbcb7596accf3bd806c8338a78a8e7bcfdf69aea8222f979696bb7"}
Sep 10 14:46:34.785112 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.784962    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1f2bd61c6bbcb7596accf3bd806c8338a78a8e7bcfdf69aea8222f979696bb7"
Sep 10 14:46:34.864109 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.864061    2561 patch_prober.go:28] interesting pod/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:46:34.864291 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:34.864123    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:46:35.516309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.516279    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:46:35.592844 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.592807    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-credential-socket\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.592867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-podinfo\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.592925    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7jjd\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-kube-api-access-c7jjd\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.592944    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-data\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593021    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-certs\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593057    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-socket\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istiod-ca-cert\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593109    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-token\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593143    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-envoy\") pod \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\" (UID: \"f9bde40c-7b82-4a56-95c2-d2e94a414d7d\") "
Sep 10 14:46:35.593336 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593160    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:35.593623 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593357    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:35.593623 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:35.593623 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593402    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:35.593623 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593502    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:35.593915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593699    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.593915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593739    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.593915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593754    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.593915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593766    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.593915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.593780    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.595448 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.595423    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:46:35.595623 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.595607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:35.595821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.595799    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-kube-api-access-c7jjd" (OuterVolumeSpecName: "kube-api-access-c7jjd") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "kube-api-access-c7jjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:46:35.595899 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.595805    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9bde40c-7b82-4a56-95c2-d2e94a414d7d" (UID: "f9bde40c-7b82-4a56-95c2-d2e94a414d7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:46:35.695303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.695260    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.695303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.695297    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7jjd\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-kube-api-access-c7jjd\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.695303 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.695308    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.695544 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.695317    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9bde40c-7b82-4a56-95c2-d2e94a414d7d-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:46:35.793879 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.793782    2561 generic.go:356] "Generic (PLEG): container finished" podID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerID="e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee" exitCode=0
Sep 10 14:46:35.793879 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.793840    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"
Sep 10 14:46:35.794095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.793873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" event={"ID":"f9bde40c-7b82-4a56-95c2-d2e94a414d7d","Type":"ContainerDied","Data":"e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee"}
Sep 10 14:46:35.794095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.793970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c" event={"ID":"f9bde40c-7b82-4a56-95c2-d2e94a414d7d","Type":"ContainerDied","Data":"384bcc8c1e81bea042e0d0e47688821bfe9df5872bd494e6da2639497327082f"}
Sep 10 14:46:35.794095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.794002    2561 scope.go:117] "RemoveContainer" containerID="e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee"
Sep 10 14:46:35.805087 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.805069    2561 scope.go:117] "RemoveContainer" containerID="5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf"
Sep 10 14:46:35.815005 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.814982    2561 scope.go:117] "RemoveContainer" containerID="e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee"
Sep 10 14:46:35.815347 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:46:35.815327    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee\": container with ID starting with e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee not found: ID does not exist" containerID="e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee"
Sep 10 14:46:35.815435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.815367    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee"} err="failed to get container status \"e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee\": rpc error: code = NotFound desc = could not find container \"e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee\": container with ID starting with e889d00d3ac399f81e604ce369f719f64adce9df5189a1570cce4bf7f6df0fee not found: ID does not exist"
Sep 10 14:46:35.815435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.815386    2561 scope.go:117] "RemoveContainer" containerID="5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf"
Sep 10 14:46:35.815715 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:46:35.815683    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf\": container with ID starting with 5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf not found: ID does not exist" containerID="5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf"
Sep 10 14:46:35.815781 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.815734    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf"} err="failed to get container status \"5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf\": rpc error: code = NotFound desc = could not find container \"5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf\": container with ID starting with 5087d85be837c26b9427d3ef8e6bbe9ca887a2d68c794663c93097f11b3960cf not found: ID does not exist"
Sep 10 14:46:35.818975 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.818956    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"]
Sep 10 14:46:35.821589 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.821565    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5121f4-openshift-default-748f85bf96-k7g2c"]
Sep 10 14:46:35.995254 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:35.995222    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" path="/var/lib/kubelet/pods/f9bde40c-7b82-4a56-95c2-d2e94a414d7d/volumes"
Sep 10 14:46:40.752371 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:40.752341    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:46:41.432901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:41.432858    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"]
Sep 10 14:46:41.435422 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:41.435398    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2dccd5-zv8kf"]
Sep 10 14:46:41.995456 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:41.995418    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c278aeb-6cf3-4ea5-b45f-c874e0f356e5" path="/var/lib/kubelet/pods/9c278aeb-6cf3-4ea5-b45f-c874e0f356e5/volumes"
Sep 10 14:46:55.711547 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.711502    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 10 14:46:55.712099 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.711585    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 10 14:46:55.930696 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.930661    2561 generic.go:356] "Generic (PLEG): container finished" podID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerID="855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641" exitCode=0
Sep 10 14:46:55.930897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.930738    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" event={"ID":"f94582bc-a5a5-4b7d-860c-846716ae30ec","Type":"ContainerDied","Data":"855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641"}
Sep 10 14:46:55.931359 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.931333    2561 scope.go:117] "RemoveContainer" containerID="855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641"
Sep 10 14:46:55.932603 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.932569    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:55.932727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.932640    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:55.932727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:55.932672    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:46:56.946930 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:56.946888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" event={"ID":"f94582bc-a5a5-4b7d-860c-846716ae30ec","Type":"ContainerStarted","Data":"af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52"}
Sep 10 14:46:57.372693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:57.372595    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:46:57.372866 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:57.372807    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 10 14:46:57.372866 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:57.372853    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 10 14:46:58.371865 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:58.371824    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 10 14:46:58.372267 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:58.371885    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 10 14:46:59.372873 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:59.372832    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 10 14:46:59.373273 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:46:59.372910    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 10 14:47:00.372328 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:00.372290    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 10 14:47:00.372521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:00.372347    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 10 14:47:01.371900 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.371866    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 10 14:47:01.372295 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.371932    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 10 14:47:01.692317 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692276    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"]
Sep 10 14:47:01.692792 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692777    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy"
Sep 10 14:47:01.692848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692793    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy"
Sep 10 14:47:01.692848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692802    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c278aeb-6cf3-4ea5-b45f-c874e0f356e5" containerName="revoke-keys"
Sep 10 14:47:01.692848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692807    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c278aeb-6cf3-4ea5-b45f-c874e0f356e5" containerName="revoke-keys"
Sep 10 14:47:01.692848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692826    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy"
Sep 10 14:47:01.692848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692832    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy"
Sep 10 14:47:01.693018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692909    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy"
Sep 10 14:47:01.693018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692917    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9bde40c-7b82-4a56-95c2-d2e94a414d7d" containerName="istio-proxy"
Sep 10 14:47:01.693018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.692927    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c278aeb-6cf3-4ea5-b45f-c874e0f356e5" containerName="revoke-keys"
Sep 10 14:47:01.695102 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.695085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.697729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.697694    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e43b34d1-openshift-default-dockercfg-22gdq\""
Sep 10 14:47:01.708416 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.708360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"]
Sep 10 14:47:01.719748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.719698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-certs\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.719915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.719799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b93d7c49-2f49-4fda-9aab-1984aa855d50-istiod-ca-cert\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.719915 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.719837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-token\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.719999 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.719952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-credential-socket\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.720040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.720003    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-socket\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.720084 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.720071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-envoy\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.720148 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.720132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-podinfo\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.720213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.720198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8hpp\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-kube-api-access-k8hpp\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.720269 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.720255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-data\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.821373 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.821320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-socket\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.821760 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.821732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-envoy\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.821979 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.821949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-podinfo\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.822175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.822142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8hpp\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-kube-api-access-k8hpp\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.822337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.822321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-data\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.822493 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.822477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-certs\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.822646 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.822630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b93d7c49-2f49-4fda-9aab-1984aa855d50-istiod-ca-cert\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.822823 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.822789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-token\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.823040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.823023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-credential-socket\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.823668 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.823645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-credential-socket\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.824126 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.824104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-socket\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.824851 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.824830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-data\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.827172 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.825985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b93d7c49-2f49-4fda-9aab-1984aa855d50-istiod-ca-cert\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.827309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.826208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-certs\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.827398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.826978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-envoy\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.840828 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.840795    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8hpp\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-kube-api-access-k8hpp\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.842996 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.842968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-token\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:01.843671 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:01.843649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-podinfo\") pod \"e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") " pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:02.006452 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.006345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:02.286825 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.286790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"]
Sep 10 14:47:02.288175 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:47:02.288146    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93d7c49_2f49_4fda_9aab_1984aa855d50.slice/crio-d5e76492a48ce452e7e7d2e16060d47874b4eafa66f3dd85015fdb27e8eab916 WatchSource:0}: Error finding container d5e76492a48ce452e7e7d2e16060d47874b4eafa66f3dd85015fdb27e8eab916: Status 404 returned error can't find the container with id d5e76492a48ce452e7e7d2e16060d47874b4eafa66f3dd85015fdb27e8eab916
Sep 10 14:47:02.290589 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.290549    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:02.290752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.290623    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:02.290752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.290668    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:02.375983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.375953    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:47:02.376508 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.376482    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:47:02.377317 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.377296    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:47:02.986519 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.986478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" event={"ID":"b93d7c49-2f49-4fda-9aab-1984aa855d50","Type":"ContainerStarted","Data":"8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326"}
Sep 10 14:47:02.986734 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:02.986547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" event={"ID":"b93d7c49-2f49-4fda-9aab-1984aa855d50","Type":"ContainerStarted","Data":"d5e76492a48ce452e7e7d2e16060d47874b4eafa66f3dd85015fdb27e8eab916"}
Sep 10 14:47:03.007041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:03.006983    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:03.008612 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:03.008561    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podStartSLOduration=2.008544564 podStartE2EDuration="2.008544564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:47:03.006068984 +0000 UTC m=+1137.470435512" watchObservedRunningTime="2026-09-10 14:47:03.008544564 +0000 UTC m=+1137.472911152"
Sep 10 14:47:03.012352 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:03.012326    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:04.000730 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:03.996895    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:04.000730 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:04.000361    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:06.567178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:06.567140    2561 scope.go:117] "RemoveContainer" containerID="85fea973d31bd4e81025230af253f60819e62e36d7f6880708edc618b0f9f72d"
Sep 10 14:47:23.810270 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:23.810231    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"]
Sep 10 14:47:23.810829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:23.810501    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy" containerID="cri-o://8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253" gracePeriod=30
Sep 10 14:47:24.659677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.659635    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"]
Sep 10 14:47:24.663981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.663959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.666511 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.666488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-12b6f6-openshift-default-dockercfg-4q8ls\""
Sep 10 14:47:24.675246 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.675220    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"]
Sep 10 14:47:24.694216 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-envoy\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50a5aba-62b6-413f-8541-5d4699636507-istio-podinfo\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-data\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-socket\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694507 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50a5aba-62b6-413f-8541-5d4699636507-istiod-ca-cert\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694507 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-istio-token\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694507 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-certs\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-credential-socket\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.694607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.694540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f62q\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-kube-api-access-8f62q\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.795842 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.795779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-socket\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796014 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.795905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50a5aba-62b6-413f-8541-5d4699636507-istiod-ca-cert\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796014 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.795942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-istio-token\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796014 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.796001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-certs\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796206 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.796061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-credential-socket\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796206 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.796089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f62q\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-kube-api-access-8f62q\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796206 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.796201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-envoy\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796360 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.796345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50a5aba-62b6-413f-8541-5d4699636507-istio-podinfo\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.796433 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.796382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-data\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.797167 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.797116    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-data\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.797530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.797492    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-socket\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.798783 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.798756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50a5aba-62b6-413f-8541-5d4699636507-istiod-ca-cert\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.799376 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.799348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-credential-socket\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.800244 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.800223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-certs\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.803991 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.803892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-envoy\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.810332 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.810284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-istio-token\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.811374 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.811353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f62q\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-kube-api-access-8f62q\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.815340 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.815318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50a5aba-62b6-413f-8541-5d4699636507-istio-podinfo\") pod \"e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") " pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:24.979865 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:24.979763    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:25.263804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:25.263769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"]
Sep 10 14:47:25.264658 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:47:25.264629    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50a5aba_62b6_413f_8541_5d4699636507.slice/crio-bfccf8521877f8f632617b4ad9149518186dc2bdc9a2c34181eb62cc1ba6c422 WatchSource:0}: Error finding container bfccf8521877f8f632617b4ad9149518186dc2bdc9a2c34181eb62cc1ba6c422: Status 404 returned error can't find the container with id bfccf8521877f8f632617b4ad9149518186dc2bdc9a2c34181eb62cc1ba6c422
Sep 10 14:47:25.267530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:25.267496    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:25.267617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:25.267559    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:25.267617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:25.267590    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:26.145827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:26.145776    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" event={"ID":"b50a5aba-62b6-413f-8541-5d4699636507","Type":"ContainerStarted","Data":"af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25"}
Sep 10 14:47:26.146459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:26.145853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" event={"ID":"b50a5aba-62b6-413f-8541-5d4699636507","Type":"ContainerStarted","Data":"bfccf8521877f8f632617b4ad9149518186dc2bdc9a2c34181eb62cc1ba6c422"}
Sep 10 14:47:26.171896 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:26.171838    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podStartSLOduration=2.171819331 podStartE2EDuration="2.171819331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:47:26.168483324 +0000 UTC m=+1160.632849883" watchObservedRunningTime="2026-09-10 14:47:26.171819331 +0000 UTC m=+1160.636185854"
Sep 10 14:47:26.980501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:26.980453    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:26.986940 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:26.986910    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:27.158137 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:27.158103    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:27.159813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:27.159781    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:29.093170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.093144    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:47:29.160622 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.160587    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-podinfo\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.160840 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.160694    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-socket\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.160840 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.160796    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-certs\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.160840 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.160813    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-token\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.161023 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.160958    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-credential-socket\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.161023 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161000    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-data\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.161023 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161023    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-envoy\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.161185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161090    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c4dc1d0-b220-44ad-9c01-306bb7320657-istiod-ca-cert\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.161185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsd7v\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-kube-api-access-bsd7v\") pod \"7c4dc1d0-b220-44ad-9c01-306bb7320657\" (UID: \"7c4dc1d0-b220-44ad-9c01-306bb7320657\") "
Sep 10 14:47:29.161185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161149    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:29.161310 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161199    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:29.161412 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161395    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4dc1d0-b220-44ad-9c01-306bb7320657-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:47:29.161595 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161581    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.161882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161861    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.161882 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161882    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c4dc1d0-b220-44ad-9c01-306bb7320657-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.162041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161779    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:29.162041 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.161793    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:29.163505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.163482    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:29.163924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.163900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:29.164026 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.163947    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-kube-api-access-bsd7v" (OuterVolumeSpecName: "kube-api-access-bsd7v") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "kube-api-access-bsd7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:29.164026 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.163950    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c4dc1d0-b220-44ad-9c01-306bb7320657" (UID: "7c4dc1d0-b220-44ad-9c01-306bb7320657"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:47:29.179955 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.179921    2561 generic.go:356] "Generic (PLEG): container finished" podID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerID="8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253" exitCode=0
Sep 10 14:47:29.180104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.179983    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"
Sep 10 14:47:29.180104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.180070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" event={"ID":"7c4dc1d0-b220-44ad-9c01-306bb7320657","Type":"ContainerDied","Data":"8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253"}
Sep 10 14:47:29.180218 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.180158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz" event={"ID":"7c4dc1d0-b220-44ad-9c01-306bb7320657","Type":"ContainerDied","Data":"e44153bffff75fe9bd16fc5842ff8e058ab9d529a1d74b718d90b4ce51f3027f"}
Sep 10 14:47:29.180218 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.180193    2561 scope.go:117] "RemoveContainer" containerID="8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253"
Sep 10 14:47:29.191987 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.191971    2561 scope.go:117] "RemoveContainer" containerID="6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b"
Sep 10 14:47:29.202486 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.202453    2561 scope.go:117] "RemoveContainer" containerID="8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253"
Sep 10 14:47:29.202815 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:47:29.202776    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253\": container with ID starting with 8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253 not found: ID does not exist" containerID="8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253"
Sep 10 14:47:29.202899 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.202823    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253"} err="failed to get container status \"8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253\": rpc error: code = NotFound desc = could not find container \"8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253\": container with ID starting with 8899f4972e6802fbd47baa4352a951c795dac274ca064705db5feea9d0185253 not found: ID does not exist"
Sep 10 14:47:29.202899 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.202839    2561 scope.go:117] "RemoveContainer" containerID="6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b"
Sep 10 14:47:29.203105 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:47:29.203082    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b\": container with ID starting with 6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b not found: ID does not exist" containerID="6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b"
Sep 10 14:47:29.203150 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.203107    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b"} err="failed to get container status \"6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b\": rpc error: code = NotFound desc = could not find container \"6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b\": container with ID starting with 6fde5d075c86be820af3c7dcdefefa2e3e263257b58bc2ffb5fd9d12442bcd9b not found: ID does not exist"
Sep 10 14:47:29.204071 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.204050    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"]
Sep 10 14:47:29.208248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.208226    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2dccd5-openshift-default-5c9f8847d6-wm2tz"]
Sep 10 14:47:29.267813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.266728    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsd7v\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-kube-api-access-bsd7v\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.267813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.266772    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.267813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.266788    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.267813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.266800    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.267813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.266814    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.267813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.266826    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c4dc1d0-b220-44ad-9c01-306bb7320657-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:29.484996 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.484957    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"]
Sep 10 14:47:29.485197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.485164    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c" podUID="5a9503f8-af00-48bd-b6b1-bfa6242b9d84" containerName="istio-proxy" containerID="cri-o://b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5" gracePeriod=30
Sep 10 14:47:29.995547 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:29.995511    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" path="/var/lib/kubelet/pods/7c4dc1d0-b220-44ad-9c01-306bb7320657/volumes"
Sep 10 14:47:34.766958 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.766930    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:47:34.934090 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934049    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-envoy\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934278 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-socket\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934278 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934241    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istiod-ca-cert\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-podinfo\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934345    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-data\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934398 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934385    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:34.934554 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934421    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-token\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934554 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-credential-socket\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934554 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22zln\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-kube-api-access-22zln\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934554 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934497    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-certs\") pod \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\" (UID: \"5a9503f8-af00-48bd-b6b1-bfa6242b9d84\") "
Sep 10 14:47:34.934815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934754    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:47:34.934815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934766    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:34.935015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934971    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:34.935015 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.934994    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:34.935153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.935133    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:34.935196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.935162    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:34.935196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.935178    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:34.935196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.935191    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:34.935315 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.935204    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:34.936900 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.936875    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:47:34.936900 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.936887    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:34.937058 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.936880    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:34.937058 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:34.937026    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-kube-api-access-22zln" (OuterVolumeSpecName: "kube-api-access-22zln") pod "5a9503f8-af00-48bd-b6b1-bfa6242b9d84" (UID: "5a9503f8-af00-48bd-b6b1-bfa6242b9d84"). InnerVolumeSpecName "kube-api-access-22zln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:35.035968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.035863    2561 patch_prober.go:28] interesting pod/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:47:35.035968 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.035922    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:47:35.036540 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.036511    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:35.036631 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.036544    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:35.036631 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.036558    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22zln\" (UniqueName: \"kubernetes.io/projected/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-kube-api-access-22zln\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:35.036631 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.036571    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a9503f8-af00-48bd-b6b1-bfa6242b9d84-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:47:35.222784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.222745    2561 generic.go:356] "Generic (PLEG): container finished" podID="5a9503f8-af00-48bd-b6b1-bfa6242b9d84" containerID="b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5" exitCode=0
Sep 10 14:47:35.222990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.222834    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"
Sep 10 14:47:35.222990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.222825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c" event={"ID":"5a9503f8-af00-48bd-b6b1-bfa6242b9d84","Type":"ContainerDied","Data":"b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5"}
Sep 10 14:47:35.223100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.223007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c" event={"ID":"5a9503f8-af00-48bd-b6b1-bfa6242b9d84","Type":"ContainerDied","Data":"45e66f833c877c197e7ee5d3b3f5d49191cda8b8a3175a2427809ac10f19f05e"}
Sep 10 14:47:35.223100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.223040    2561 scope.go:117] "RemoveContainer" containerID="b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5"
Sep 10 14:47:35.235253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.235226    2561 scope.go:117] "RemoveContainer" containerID="b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5"
Sep 10 14:47:35.235580 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:47:35.235556    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5\": container with ID starting with b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5 not found: ID does not exist" containerID="b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5"
Sep 10 14:47:35.235680 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.235585    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5"} err="failed to get container status \"b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5\": rpc error: code = NotFound desc = could not find container \"b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5\": container with ID starting with b54abb5f3e470c64d758bfde5d933aa2404d0950bc17bcd9644630c57a66b4c5 not found: ID does not exist"
Sep 10 14:47:35.251393 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.250884    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"]
Sep 10 14:47:35.254605 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.254571    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-b20fba-openshift-default-7fb57485c4-fpc8c"]
Sep 10 14:47:35.995625 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:35.995543    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a9503f8-af00-48bd-b6b1-bfa6242b9d84" path="/var/lib/kubelet/pods/5a9503f8-af00-48bd-b6b1-bfa6242b9d84/volumes"
Sep 10 14:47:36.234166 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:36.234134    2561 generic.go:356] "Generic (PLEG): container finished" podID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerID="8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326" exitCode=0
Sep 10 14:47:36.234356 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:36.234207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" event={"ID":"b93d7c49-2f49-4fda-9aab-1984aa855d50","Type":"ContainerDied","Data":"8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326"}
Sep 10 14:47:36.234697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:36.234681    2561 scope.go:117] "RemoveContainer" containerID="8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326"
Sep 10 14:47:36.235897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:36.235865    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:36.235998 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:36.235933    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:36.235998 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:36.235967    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:37.253177 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:37.253037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" event={"ID":"b93d7c49-2f49-4fda-9aab-1984aa855d50","Type":"ContainerStarted","Data":"598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4"}
Sep 10 14:47:38.006984 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:38.006950    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:38.007177 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:38.007155    2561 patch_prober.go:28] interesting pod/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 14:47:38.007223 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:38.007203    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 14:47:39.006858 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:39.006819    2561 patch_prober.go:28] interesting pod/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 14:47:39.007252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:39.006914    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 14:47:40.007151 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:40.007116    2561 patch_prober.go:28] interesting pod/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 14:47:40.007553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:40.007172    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 14:47:41.007784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:41.007745    2561 patch_prober.go:28] interesting pod/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 14:47:41.008248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:41.007808    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 14:47:42.007185 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:42.007145    2561 patch_prober.go:28] interesting pod/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 10 14:47:42.007372 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:42.007216    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 10 14:47:43.011156 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:43.011117    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:43.011639 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:43.011539    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:43.012415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:43.012394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:47:52.367392 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:52.367360    2561 generic.go:356] "Generic (PLEG): container finished" podID="b50a5aba-62b6-413f-8541-5d4699636507" containerID="af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25" exitCode=0
Sep 10 14:47:52.367927 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:52.367432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" event={"ID":"b50a5aba-62b6-413f-8541-5d4699636507","Type":"ContainerDied","Data":"af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25"}
Sep 10 14:47:52.368030 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:52.368013    2561 scope.go:117] "RemoveContainer" containerID="af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25"
Sep 10 14:47:52.369384 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:52.369347    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:52.369493 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:52.369426    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:52.369493 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:52.369457    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:53.375874 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.375840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" event={"ID":"b50a5aba-62b6-413f-8541-5d4699636507","Type":"ContainerStarted","Data":"85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909"}
Sep 10 14:47:53.711290 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.711249    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"]
Sep 10 14:47:53.711928 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.711906    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy"
Sep 10 14:47:53.711928 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.711928    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy"
Sep 10 14:47:53.712123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.711941    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9503f8-af00-48bd-b6b1-bfa6242b9d84" containerName="istio-proxy"
Sep 10 14:47:53.712123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.711950    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9503f8-af00-48bd-b6b1-bfa6242b9d84" containerName="istio-proxy"
Sep 10 14:47:53.712123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.711980    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy"
Sep 10 14:47:53.712123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.711988    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy"
Sep 10 14:47:53.712123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.712114    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a9503f8-af00-48bd-b6b1-bfa6242b9d84" containerName="istio-proxy"
Sep 10 14:47:53.712378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.712132    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy"
Sep 10 14:47:53.712378 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.712140    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4dc1d0-b220-44ad-9c01-306bb7320657" containerName="istio-proxy"
Sep 10 14:47:53.714439 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.714410    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.716871 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.716852    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e6941c-openshift-default-dockercfg-6dlnp\""
Sep 10 14:47:53.727627 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.727593    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"]
Sep 10 14:47:53.761280 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-kube-api-access-8tkcc\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761280 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-token\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761477 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-socket\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761477 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istiod-ca-cert\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761477 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-podinfo\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761581 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-certs\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761581 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-data\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761645 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-credential-socket\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.761645 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.761608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-envoy\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862399 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-data\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862440    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-credential-socket\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-envoy\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-kube-api-access-8tkcc\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-token\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-socket\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istiod-ca-cert\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-podinfo\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.862920 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.862814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-certs\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.863422 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.863389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-data\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.863537 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.863445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-credential-socket\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.863615 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.863591    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istiod-ca-cert\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.863718 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.863679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-certs\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.863789 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.863730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-socket\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.865480 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.865458    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-envoy\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.866195 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.866176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-podinfo\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.870649 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.870624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-token\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.870848 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.870831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-kube-api-access-8tkcc\") pod \"e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") " pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:53.980273 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.980185    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:53.981125 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.981098    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 14:47:53.981251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:53.981168    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 14:47:54.026803 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.026769    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:54.303381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.303347    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"]
Sep 10 14:47:54.304798 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:47:54.304765    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d704cb4_fdf6_4135_bf6c_3eb1aa723f54.slice/crio-d601150338c6cb754af0141c478774e6851d0e8d5f5edbe45ef3a9b53c6adbf0 WatchSource:0}: Error finding container d601150338c6cb754af0141c478774e6851d0e8d5f5edbe45ef3a9b53c6adbf0: Status 404 returned error can't find the container with id d601150338c6cb754af0141c478774e6851d0e8d5f5edbe45ef3a9b53c6adbf0
Sep 10 14:47:54.308028 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.307958    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:54.308149 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.308129    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:54.308212 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.308180    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:47:54.384188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.384156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" event={"ID":"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54","Type":"ContainerStarted","Data":"d601150338c6cb754af0141c478774e6851d0e8d5f5edbe45ef3a9b53c6adbf0"}
Sep 10 14:47:54.981209 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.981169    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 14:47:54.981379 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:54.981231    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 14:47:55.393418 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:55.393329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" event={"ID":"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54","Type":"ContainerStarted","Data":"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"}
Sep 10 14:47:55.413245 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:55.413192    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podStartSLOduration=2.413174359 podStartE2EDuration="2.413174359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:47:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:47:55.41249014 +0000 UTC m=+1189.876856676" watchObservedRunningTime="2026-09-10 14:47:55.413174359 +0000 UTC m=+1189.877540881"
Sep 10 14:47:55.980297 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:55.980254    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 14:47:55.980507 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:55.980321    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 14:47:56.027816 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:56.027755    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:56.039044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:56.039000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:56.400988 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:56.400956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:56.402054 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:56.402032    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:47:56.981076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:56.981035    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 14:47:56.981267 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:56.981104    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 14:47:57.158495 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:57.158457    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:57.981129 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:57.981089    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 14:47:57.981520 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:57.981151    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 14:47:58.981155 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:58.981114    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 14:47:58.981565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:58.981171    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 14:47:59.541954 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.541910    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"]
Sep 10 14:47:59.545841 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.545813    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.549749 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.549717    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-e6941c\""
Sep 10 14:47:59.550003 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.549969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-e6941c-dockercfg-hp6gk\""
Sep 10 14:47:59.559934 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.559900    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"]
Sep 10 14:47:59.627577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.627540    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"]
Sep 10 14:47:59.630431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.630408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.640371 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.640333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279e395a-e7a4-40b3-a45d-7f841df6c6df-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.640524 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.640464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsxwv\" (UniqueName: \"kubernetes.io/projected/279e395a-e7a4-40b3-a45d-7f841df6c6df-kube-api-access-wsxwv\") pod \"payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.642355 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.642326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"]
Sep 10 14:47:59.742224 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.742185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279e395a-e7a4-40b3-a45d-7f841df6c6df-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.742424 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.742246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/691545f2-d651-426f-beb4-2da71de50eff-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.742424 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.742338    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsxwv\" (UniqueName: \"kubernetes.io/projected/279e395a-e7a4-40b3-a45d-7f841df6c6df-kube-api-access-wsxwv\") pod \"payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.742424 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.742401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmtm\" (UniqueName: \"kubernetes.io/projected/691545f2-d651-426f-beb4-2da71de50eff-kube-api-access-jsmtm\") pod \"payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.743082 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.743056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279e395a-e7a4-40b3-a45d-7f841df6c6df-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.763122 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.763077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsxwv\" (UniqueName: \"kubernetes.io/projected/279e395a-e7a4-40b3-a45d-7f841df6c6df-kube-api-access-wsxwv\") pod \"payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.843867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.843749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/691545f2-d651-426f-beb4-2da71de50eff-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.843867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.843863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmtm\" (UniqueName: \"kubernetes.io/projected/691545f2-d651-426f-beb4-2da71de50eff-kube-api-access-jsmtm\") pod \"payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.845275 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.845220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/691545f2-d651-426f-beb4-2da71de50eff-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.861139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.861099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:47:59.862220 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.862181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmtm\" (UniqueName: \"kubernetes.io/projected/691545f2-d651-426f-beb4-2da71de50eff-kube-api-access-jsmtm\") pod \"payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.943355 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.943327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:47:59.984991 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.984960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:47:59.986166 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:47:59.986141    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 14:48:00.140520 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.140489    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"]
Sep 10 14:48:00.142540 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:48:00.142493    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279e395a_e7a4_40b3_a45d_7f841df6c6df.slice/crio-b6de24489598a64b168c4c87f49ec2a82660ff07b87920037dface619c81f093 WatchSource:0}: Error finding container b6de24489598a64b168c4c87f49ec2a82660ff07b87920037dface619c81f093: Status 404 returned error can't find the container with id b6de24489598a64b168c4c87f49ec2a82660ff07b87920037dface619c81f093
Sep 10 14:48:00.224902 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.224868    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"]
Sep 10 14:48:00.225508 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:48:00.225478    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691545f2_d651_426f_beb4_2da71de50eff.slice/crio-7c7a9f9a64ef5f4f25b82ec99914a22832c7d0e68b1731642313709e3c488828 WatchSource:0}: Error finding container 7c7a9f9a64ef5f4f25b82ec99914a22832c7d0e68b1731642313709e3c488828: Status 404 returned error can't find the container with id 7c7a9f9a64ef5f4f25b82ec99914a22832c7d0e68b1731642313709e3c488828
Sep 10 14:48:00.431598 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.431559    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk" event={"ID":"691545f2-d651-426f-beb4-2da71de50eff","Type":"ContainerStarted","Data":"7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860"}
Sep 10 14:48:00.431824 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.431621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk" event={"ID":"691545f2-d651-426f-beb4-2da71de50eff","Type":"ContainerStarted","Data":"7c7a9f9a64ef5f4f25b82ec99914a22832c7d0e68b1731642313709e3c488828"}
Sep 10 14:48:00.431824 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.431670    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:48:00.433496 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.433469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr" event={"ID":"279e395a-e7a4-40b3-a45d-7f841df6c6df","Type":"ContainerStarted","Data":"37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8"}
Sep 10 14:48:00.433656 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.433519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr" event={"ID":"279e395a-e7a4-40b3-a45d-7f841df6c6df","Type":"ContainerStarted","Data":"b6de24489598a64b168c4c87f49ec2a82660ff07b87920037dface619c81f093"}
Sep 10 14:48:00.433752 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.433717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:48:00.450547 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.450493    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk" podStartSLOduration=1.450476783 podStartE2EDuration="1.450476783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:48:00.447166782 +0000 UTC m=+1194.911533302" watchObservedRunningTime="2026-09-10 14:48:00.450476783 +0000 UTC m=+1194.914843305"
Sep 10 14:48:00.464191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:00.464133    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr" podStartSLOduration=1.4641114960000001 podStartE2EDuration="1.464111496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:48:00.462602471 +0000 UTC m=+1194.926968994" watchObservedRunningTime="2026-09-10 14:48:00.464111496 +0000 UTC m=+1194.928478021"
Sep 10 14:48:06.606729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:06.606667    2561 scope.go:117] "RemoveContainer" containerID="aaeb7b93d701924c2bb50022c459f3839ba2ae9a8ea7647592662e37364ea4bb"
Sep 10 14:48:11.443914 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:11.443879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 14:48:11.444331 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:11.444183    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 14:48:30.640867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:30.640826    2561 generic.go:356] "Generic (PLEG): container finished" podID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerID="9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6" exitCode=0
Sep 10 14:48:30.641314 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:30.640891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" event={"ID":"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54","Type":"ContainerDied","Data":"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"}
Sep 10 14:48:30.641363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:30.641353    2561 scope.go:117] "RemoveContainer" containerID="9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"
Sep 10 14:48:30.642744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:30.642694    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:48:30.642829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:30.642787    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:48:30.642829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:30.642821    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:48:31.649715 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:31.649666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" event={"ID":"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54","Type":"ContainerStarted","Data":"7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"}
Sep 10 14:48:32.027172 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:32.027074    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:48:32.027392 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:32.027363    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 10 14:48:32.027476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:32.027425    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 10 14:48:33.027257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:33.027203    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 10 14:48:33.027797 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:33.027287    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 10 14:48:34.027730 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:34.027661    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 10 14:48:34.028269 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:34.027761    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 10 14:48:35.027407 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:35.027359    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 10 14:48:35.027632 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:35.027432    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 10 14:48:36.039231 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:36.039183    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 10 14:48:36.039770 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:36.039277    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 10 14:48:37.028039 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:37.027989    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 10 14:48:37.028272 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:37.028077    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 10 14:48:38.032067 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:38.032032    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:48:38.032513 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:38.032288    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:48:38.033133 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:48:38.033115    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 14:49:06.641269 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:06.641177    2561 scope.go:117] "RemoveContainer" containerID="37375d461c64c705f2e7d47c893ce8c32100e98f13cc9d6338e1e5fa18625833"
Sep 10 14:49:06.652296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:06.652267    2561 scope.go:117] "RemoveContainer" containerID="1c72bfca6e08876f311404f72e41d4310cf4c15460d89cbcc55bc95e06b1a9b1"
Sep 10 14:49:06.661521 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:06.661498    2561 scope.go:117] "RemoveContainer" containerID="f96fc0cfe8c61cc5e29404dd9f2085c6527da8b29be30372f0f572ac920edaea"
Sep 10 14:49:22.968511 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:22.968464    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"]
Sep 10 14:49:22.972435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:22.972411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"
Sep 10 14:49:22.975186 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:22.975152    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:49:22.979037 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:22.979005    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"]
Sep 10 14:49:23.158077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:23.158032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60370cf8-8144-4d62-a01d-8e70464f3a19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52\" (UID: \"60370cf8-8144-4d62-a01d-8e70464f3a19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"
Sep 10 14:49:23.258852 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:23.258762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60370cf8-8144-4d62-a01d-8e70464f3a19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52\" (UID: \"60370cf8-8144-4d62-a01d-8e70464f3a19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"
Sep 10 14:49:23.259423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:23.259400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60370cf8-8144-4d62-a01d-8e70464f3a19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52\" (UID: \"60370cf8-8144-4d62-a01d-8e70464f3a19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"
Sep 10 14:49:23.286636 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:23.286587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"
Sep 10 14:49:23.564307 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:23.564279    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"]
Sep 10 14:49:23.565369 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:49:23.565345    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60370cf8_8144_4d62_a01d_8e70464f3a19.slice/crio-98390d7f3b76e4e4259b808f0716065252f2ca2c8c951d04453385e6761590fb WatchSource:0}: Error finding container 98390d7f3b76e4e4259b808f0716065252f2ca2c8c951d04453385e6761590fb: Status 404 returned error can't find the container with id 98390d7f3b76e4e4259b808f0716065252f2ca2c8c951d04453385e6761590fb
Sep 10 14:49:24.005275 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:24.005238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52" event={"ID":"60370cf8-8144-4d62-a01d-8e70464f3a19","Type":"ContainerStarted","Data":"ca68c4ffdfe149e5cb8cd3d5e35ccfec8f259936247c12e20488b62cd4dc445c"}
Sep 10 14:49:24.005683 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:24.005295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52" event={"ID":"60370cf8-8144-4d62-a01d-8e70464f3a19","Type":"ContainerStarted","Data":"98390d7f3b76e4e4259b808f0716065252f2ca2c8c951d04453385e6761590fb"}
Sep 10 14:49:24.021106 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:24.021051    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52" podStartSLOduration=2.021033509 podStartE2EDuration="2.021033509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:49:24.018956767 +0000 UTC m=+1278.483323293" watchObservedRunningTime="2026-09-10 14:49:24.021033509 +0000 UTC m=+1278.485400032"
Sep 10 14:49:25.013640 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:25.013605    2561 generic.go:356] "Generic (PLEG): container finished" podID="60370cf8-8144-4d62-a01d-8e70464f3a19" containerID="ca68c4ffdfe149e5cb8cd3d5e35ccfec8f259936247c12e20488b62cd4dc445c" exitCode=0
Sep 10 14:49:25.014072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:25.013654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52" event={"ID":"60370cf8-8144-4d62-a01d-8e70464f3a19","Type":"ContainerDied","Data":"ca68c4ffdfe149e5cb8cd3d5e35ccfec8f259936247c12e20488b62cd4dc445c"}
Sep 10 14:49:26.162784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:26.162752    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"
Sep 10 14:49:26.190905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:26.190873    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60370cf8-8144-4d62-a01d-8e70464f3a19-maas-api-service-ca\") pod \"60370cf8-8144-4d62-a01d-8e70464f3a19\" (UID: \"60370cf8-8144-4d62-a01d-8e70464f3a19\") "
Sep 10 14:49:26.191298 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:26.191270    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60370cf8-8144-4d62-a01d-8e70464f3a19-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60370cf8-8144-4d62-a01d-8e70464f3a19" (UID: "60370cf8-8144-4d62-a01d-8e70464f3a19"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:49:26.191428 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:26.191413    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60370cf8-8144-4d62-a01d-8e70464f3a19-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:49:27.028007 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:27.027975    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"
Sep 10 14:49:27.028188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:27.027978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52" event={"ID":"60370cf8-8144-4d62-a01d-8e70464f3a19","Type":"ContainerDied","Data":"98390d7f3b76e4e4259b808f0716065252f2ca2c8c951d04453385e6761590fb"}
Sep 10 14:49:27.028188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:27.028103    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98390d7f3b76e4e4259b808f0716065252f2ca2c8c951d04453385e6761590fb"
Sep 10 14:49:38.762100 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:38.762063    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"]
Sep 10 14:49:38.764539 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:38.764515    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e43b34d1-h4w52"]
Sep 10 14:49:39.995939 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:49:39.995902    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60370cf8-8144-4d62-a01d-8e70464f3a19" path="/var/lib/kubelet/pods/60370cf8-8144-4d62-a01d-8e70464f3a19/volumes"
Sep 10 14:50:35.398038 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:35.397832    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"]
Sep 10 14:50:35.398628 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:35.398147    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy" containerID="cri-o://598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4" gracePeriod=30
Sep 10 14:50:40.670128 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.670049    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:50:40.766905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.766873    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b93d7c49-2f49-4fda-9aab-1984aa855d50-istiod-ca-cert\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.766914    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-podinfo\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.766965    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-envoy\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.766995    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-token\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767054    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-socket\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767074    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-certs\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767156    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8hpp\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-kube-api-access-k8hpp\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767188    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-data\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767226    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-credential-socket\") pod \"b93d7c49-2f49-4fda-9aab-1984aa855d50\" (UID: \"b93d7c49-2f49-4fda-9aab-1984aa855d50\") "
Sep 10 14:50:40.767381 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767328    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b93d7c49-2f49-4fda-9aab-1984aa855d50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:40.767589 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:40.767697 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767677    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-data" (OuterVolumeSpecName: "istio-data") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:40.767849 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767811    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b93d7c49-2f49-4fda-9aab-1984aa855d50-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.767849 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767851    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.768037 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:40.768037 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.767717    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:40.769355 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.769326    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:40.769440 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.769385    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:50:40.769440 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.769421    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-token" (OuterVolumeSpecName: "istio-token") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:40.769512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.769440    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-kube-api-access-k8hpp" (OuterVolumeSpecName: "kube-api-access-k8hpp") pod "b93d7c49-2f49-4fda-9aab-1984aa855d50" (UID: "b93d7c49-2f49-4fda-9aab-1984aa855d50"). InnerVolumeSpecName "kube-api-access-k8hpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:40.868617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.868573    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.868617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.868608    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.868617 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.868620    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.868948 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.868634    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.868948 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.868643    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.868948 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.868656    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8hpp\" (UniqueName: \"kubernetes.io/projected/b93d7c49-2f49-4fda-9aab-1984aa855d50-kube-api-access-k8hpp\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:40.868948 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:40.868665    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b93d7c49-2f49-4fda-9aab-1984aa855d50-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:50:41.519232 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.519195    2561 generic.go:356] "Generic (PLEG): container finished" podID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerID="598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4" exitCode=0
Sep 10 14:50:41.519449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.519271    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"
Sep 10 14:50:41.519449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.519289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" event={"ID":"b93d7c49-2f49-4fda-9aab-1984aa855d50","Type":"ContainerDied","Data":"598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4"}
Sep 10 14:50:41.519449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.519360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k" event={"ID":"b93d7c49-2f49-4fda-9aab-1984aa855d50","Type":"ContainerDied","Data":"d5e76492a48ce452e7e7d2e16060d47874b4eafa66f3dd85015fdb27e8eab916"}
Sep 10 14:50:41.519449 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.519390    2561 scope.go:117] "RemoveContainer" containerID="598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4"
Sep 10 14:50:41.531947 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.531927    2561 scope.go:117] "RemoveContainer" containerID="8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326"
Sep 10 14:50:41.541956 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.541928    2561 scope.go:117] "RemoveContainer" containerID="598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4"
Sep 10 14:50:41.542388 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:50:41.542330    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4\": container with ID starting with 598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4 not found: ID does not exist" containerID="598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4"
Sep 10 14:50:41.542494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.542429    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4"} err="failed to get container status \"598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4\": rpc error: code = NotFound desc = could not find container \"598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4\": container with ID starting with 598505ab5fee4c864ed915d720ac0087ad5ffc66b0fa1545ee5536ce46ea29e4 not found: ID does not exist"
Sep 10 14:50:41.542494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.542459    2561 scope.go:117] "RemoveContainer" containerID="8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326"
Sep 10 14:50:41.542953 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:50:41.542912    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326\": container with ID starting with 8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326 not found: ID does not exist" containerID="8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326"
Sep 10 14:50:41.543081 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.542948    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326"} err="failed to get container status \"8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326\": rpc error: code = NotFound desc = could not find container \"8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326\": container with ID starting with 8e32e95d6e9f2eea6b8f6d8061f97826881dfb638b2eb68961325b0327695326 not found: ID does not exist"
Sep 10 14:50:41.543327 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.543306    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"]
Sep 10 14:50:41.545871 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.545850    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e43b34d1-openshift-default-bf5c569d8-nrt8k"]
Sep 10 14:50:41.996457 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:41.996421    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" path="/var/lib/kubelet/pods/b93d7c49-2f49-4fda-9aab-1984aa855d50/volumes"
Sep 10 14:50:48.566718 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:48.566671    2561 generic.go:356] "Generic (PLEG): container finished" podID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerID="63aea0c4846d2e9f1a2385401cc932cfeff7fff781b082fb1683e8708e9cfc3d" exitCode=137
Sep 10 14:50:48.567198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:48.566743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerDied","Data":"63aea0c4846d2e9f1a2385401cc932cfeff7fff781b082fb1683e8708e9cfc3d"}
Sep 10 14:50:48.567198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:48.567094    2561 scope.go:117] "RemoveContainer" containerID="63aea0c4846d2e9f1a2385401cc932cfeff7fff781b082fb1683e8708e9cfc3d"
Sep 10 14:50:49.205407 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:49.205355    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:50:49.575784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:49.575661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerStarted","Data":"f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"}
Sep 10 14:50:49.575784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:49.575758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:50:50.241119 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.241082    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"]
Sep 10 14:50:50.241959 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.241939    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60370cf8-8144-4d62-a01d-8e70464f3a19" containerName="revoke-keys"
Sep 10 14:50:50.242007 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.241961    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="60370cf8-8144-4d62-a01d-8e70464f3a19" containerName="revoke-keys"
Sep 10 14:50:50.242059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.242017    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy"
Sep 10 14:50:50.242059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.242027    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy"
Sep 10 14:50:50.242059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.242040    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy"
Sep 10 14:50:50.242059 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.242049    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy"
Sep 10 14:50:50.242207 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.242195    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy"
Sep 10 14:50:50.242243 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.242217    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b93d7c49-2f49-4fda-9aab-1984aa855d50" containerName="istio-proxy"
Sep 10 14:50:50.242243 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.242226    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="60370cf8-8144-4d62-a01d-8e70464f3a19" containerName="revoke-keys"
Sep 10 14:50:50.245618 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.245599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.248258 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.248234    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"kube-root-ca.crt\""
Sep 10 14:50:50.249457 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.249432    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"openshift-service-ca.crt\""
Sep 10 14:50:50.249572 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.249480    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"default-dockercfg-xkqhb\""
Sep 10 14:50:50.249572 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.249487    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"auth-test-model-e6941c-kserve-self-signed-certs\""
Sep 10 14:50:50.253669 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.253481    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"]
Sep 10 14:50:50.283498 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.283458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-home\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.283729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.283518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphhs\" (UniqueName: \"kubernetes.io/projected/febe2d6e-b80d-4298-8ff6-eb5dda646209-kube-api-access-tphhs\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.283729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.283634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-model-cache\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.283729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.283675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/febe2d6e-b80d-4298-8ff6-eb5dda646209-tls-certs\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.283923 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.283751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-dshm\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.283923 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.283800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-tmp-dir\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385073 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-home\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385276 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphhs\" (UniqueName: \"kubernetes.io/projected/febe2d6e-b80d-4298-8ff6-eb5dda646209-kube-api-access-tphhs\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385276 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-model-cache\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385276 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/febe2d6e-b80d-4298-8ff6-eb5dda646209-tls-certs\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385276 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385211    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-dshm\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385276 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-tmp-dir\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-home\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385597 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-model-cache\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.385632 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.385615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-tmp-dir\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.387614 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.387583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-dshm\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.387863 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.387844    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/febe2d6e-b80d-4298-8ff6-eb5dda646209-tls-certs\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.394492 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.394464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphhs\" (UniqueName: \"kubernetes.io/projected/febe2d6e-b80d-4298-8ff6-eb5dda646209-kube-api-access-tphhs\") pod \"auth-test-model-e6941c-kserve-c9457867-h9xz2\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.557173 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.557084    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:50:50.838756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:50.838694    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"]
Sep 10 14:50:50.841766 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:50:50.841693    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfebe2d6e_b80d_4298_8ff6_eb5dda646209.slice/crio-f404bf7f30634cac9c0e1f3146bbefda0ab336c28c6e17d2181d84b10a961cd9 WatchSource:0}: Error finding container f404bf7f30634cac9c0e1f3146bbefda0ab336c28c6e17d2181d84b10a961cd9: Status 404 returned error can't find the container with id f404bf7f30634cac9c0e1f3146bbefda0ab336c28c6e17d2181d84b10a961cd9
Sep 10 14:50:51.591269 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:51.591232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2" event={"ID":"febe2d6e-b80d-4298-8ff6-eb5dda646209","Type":"ContainerStarted","Data":"f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2"}
Sep 10 14:50:51.591450 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:51.591279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2" event={"ID":"febe2d6e-b80d-4298-8ff6-eb5dda646209","Type":"ContainerStarted","Data":"f404bf7f30634cac9c0e1f3146bbefda0ab336c28c6e17d2181d84b10a961cd9"}
Sep 10 14:50:51.617319 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:50:51.617259    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2" podStartSLOduration=1.6172403929999999 podStartE2EDuration="1.617240393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:50:51.613788021 +0000 UTC m=+1366.078154540" watchObservedRunningTime="2026-09-10 14:50:51.617240393 +0000 UTC m=+1366.081606926"
Sep 10 14:51:00.558013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:00.557959    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:51:00.558013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:00.558025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:51:00.571479 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:00.571449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:51:00.585409 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:00.585370    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:51:00.665513 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:00.665481    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:51:06.703761 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:06.703726    2561 scope.go:117] "RemoveContainer" containerID="055b7fe7ea73c803a65fa97479337f9318ae1093f9be8cfd04e39506df937aef"
Sep 10 14:51:06.719967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:06.719938    2561 scope.go:117] "RemoveContainer" containerID="224a68cd879fa5203b39ab1c42fc5df2ed788930628a889c840eb69db08d5ddb"
Sep 10 14:51:06.729870 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:06.729847    2561 scope.go:117] "RemoveContainer" containerID="fa902bf9c0195500bd5dbfae3295e85760b56dea4454dd403f07e0cb2a669052"
Sep 10 14:51:30.803901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.803862    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"]
Sep 10 14:51:30.808651 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.808623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.811245 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.811216    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6eb765-openshift-default-dockercfg-6cs75\""
Sep 10 14:51:30.819936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.819908    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"]
Sep 10 14:51:30.966145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-socket\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-data\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-credential-socket\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-envoy\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-certs\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966465 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-podinfo\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966634 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-token\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966634 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz6xg\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-kube-api-access-fz6xg\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:30.966771 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:30.966658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istiod-ca-cert\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.068445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.068341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-podinfo\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.068445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.068391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-token\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.068680 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.068513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz6xg\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-kube-api-access-fz6xg\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.068680 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.068655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istiod-ca-cert\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.068825 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.068698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-socket\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.068825 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.068787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-data\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.068962 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.068936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-credential-socket\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.069017 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.069000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-envoy\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.069120 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.069094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-certs\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.069259 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.069236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-data\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.069331 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.069270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-socket\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.069393 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.069374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-credential-socket\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.069448 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.069423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-certs\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.069584 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.069562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istiod-ca-cert\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.071077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.071054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-envoy\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.071146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.071067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-podinfo\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.080365 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.080341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-token\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.081076 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.081054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz6xg\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-kube-api-access-fz6xg\") pod \"e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") " pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.123080 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.123034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:31.401431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.401398    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"]
Sep 10 14:51:31.402464 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:51:31.402436    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa52adc_989d_4a97_ad59_ebd9d36d22f0.slice/crio-3a429ebdb4f68254bc7d021a28855aff7868d6232e9708a4636494116dd4dcf2 WatchSource:0}: Error finding container 3a429ebdb4f68254bc7d021a28855aff7868d6232e9708a4636494116dd4dcf2: Status 404 returned error can't find the container with id 3a429ebdb4f68254bc7d021a28855aff7868d6232e9708a4636494116dd4dcf2
Sep 10 14:51:31.405024 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.404982    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:51:31.405104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.405080    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:51:31.405145 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.405126    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:51:31.856051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.855958    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" event={"ID":"1aa52adc-989d-4a97-ad59-ebd9d36d22f0","Type":"ContainerStarted","Data":"39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543"}
Sep 10 14:51:31.856051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.856026    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" event={"ID":"1aa52adc-989d-4a97-ad59-ebd9d36d22f0","Type":"ContainerStarted","Data":"3a429ebdb4f68254bc7d021a28855aff7868d6232e9708a4636494116dd4dcf2"}
Sep 10 14:51:31.876072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:31.876015    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podStartSLOduration=1.8759984360000002 podStartE2EDuration="1.875998436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:51:31.873648713 +0000 UTC m=+1406.338015236" watchObservedRunningTime="2026-09-10 14:51:31.875998436 +0000 UTC m=+1406.340364955"
Sep 10 14:51:32.123349 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:32.123264    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:32.129473 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:32.129440    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:32.862583 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:32.862550    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:32.863821 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:32.863799    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:51:35.666967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.666928    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"]
Sep 10 14:51:35.671027 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.671004    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:35.673823 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.673797    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-6eb765\""
Sep 10 14:51:35.673823 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.673797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-6eb765-dockercfg-nsrjc\""
Sep 10 14:51:35.682069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.681258    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"]
Sep 10 14:51:35.831765 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.831695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73a4a628-ea91-47c2-b849-e07b3680668a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") " pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:35.831971 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.831935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxlx\" (UniqueName: \"kubernetes.io/projected/73a4a628-ea91-47c2-b849-e07b3680668a-kube-api-access-npxlx\") pod \"payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") " pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:35.932992 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.932902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73a4a628-ea91-47c2-b849-e07b3680668a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") " pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:35.933158 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.933036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npxlx\" (UniqueName: \"kubernetes.io/projected/73a4a628-ea91-47c2-b849-e07b3680668a-kube-api-access-npxlx\") pod \"payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") " pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:35.933830 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.933806    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73a4a628-ea91-47c2-b849-e07b3680668a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") " pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:35.940971 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.940948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxlx\" (UniqueName: \"kubernetes.io/projected/73a4a628-ea91-47c2-b849-e07b3680668a-kube-api-access-npxlx\") pod \"payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") " pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:35.985804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:35.985770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:36.261195 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:36.261169    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"]
Sep 10 14:51:36.263301 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:51:36.263271    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a4a628_ea91_47c2_b849_e07b3680668a.slice/crio-a932bc52eb4b3d86e9a18c2c5f4aff9b2b989e0446377f712b0f138a1419e42d WatchSource:0}: Error finding container a932bc52eb4b3d86e9a18c2c5f4aff9b2b989e0446377f712b0f138a1419e42d: Status 404 returned error can't find the container with id a932bc52eb4b3d86e9a18c2c5f4aff9b2b989e0446377f712b0f138a1419e42d
Sep 10 14:51:36.890211 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:36.890165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5" event={"ID":"73a4a628-ea91-47c2-b849-e07b3680668a","Type":"ContainerStarted","Data":"63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0"}
Sep 10 14:51:36.890211 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:36.890218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5" event={"ID":"73a4a628-ea91-47c2-b849-e07b3680668a","Type":"ContainerStarted","Data":"a932bc52eb4b3d86e9a18c2c5f4aff9b2b989e0446377f712b0f138a1419e42d"}
Sep 10 14:51:36.890829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:36.890298    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:36.907577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:36.907527    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5" podStartSLOduration=1.907511504 podStartE2EDuration="1.907511504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:51:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:51:36.904399786 +0000 UTC m=+1411.368766310" watchObservedRunningTime="2026-09-10 14:51:36.907511504 +0000 UTC m=+1411.371878055"
Sep 10 14:51:47.899187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:47.899152    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:51:59.450298 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.450218    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"]
Sep 10 14:51:59.454300 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.454278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.456963 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.456936    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f1b717-openshift-default-dockercfg-jk8fk\""
Sep 10 14:51:59.464696 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.464661    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"]
Sep 10 14:51:59.618013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.617963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-certs\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618099    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-socket\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-istio-token\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5wd\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-kube-api-access-zw5wd\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-data\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618506 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-envoy\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618506 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74115c0e-798a-43fa-98ea-277e61225907-istiod-ca-cert\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618506 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-credential-socket\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.618506 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.618445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74115c0e-798a-43fa-98ea-277e61225907-istio-podinfo\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719632 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-envoy\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719632 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74115c0e-798a-43fa-98ea-277e61225907-istiod-ca-cert\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719632 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-credential-socket\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74115c0e-798a-43fa-98ea-277e61225907-istio-podinfo\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-certs\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-socket\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-istio-token\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5wd\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-kube-api-access-zw5wd\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.719951 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.719913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-data\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.720271 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.720082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-credential-socket\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.720271 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.720238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-socket\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.720375 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.720291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-data\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.720430 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.720377    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74115c0e-798a-43fa-98ea-277e61225907-istiod-ca-cert\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.720683 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.720659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-certs\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.721958 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.721934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-envoy\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.722592 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.722570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74115c0e-798a-43fa-98ea-277e61225907-istio-podinfo\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.728770 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.728743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-istio-token\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.728878 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.728824    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5wd\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-kube-api-access-zw5wd\") pod \"e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") " pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:51:59.766199 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:51:59.766167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:00.043727 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:00.043683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"]
Sep 10 14:52:00.044503 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:52:00.044475    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74115c0e_798a_43fa_98ea_277e61225907.slice/crio-3ac35b04f92a18972e0adc0ee7248bec0a088aa6e7bd0c0a7fe9a7d26bcf866f WatchSource:0}: Error finding container 3ac35b04f92a18972e0adc0ee7248bec0a088aa6e7bd0c0a7fe9a7d26bcf866f: Status 404 returned error can't find the container with id 3ac35b04f92a18972e0adc0ee7248bec0a088aa6e7bd0c0a7fe9a7d26bcf866f
Sep 10 14:52:00.047008 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:00.046970    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:00.047077 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:00.047046    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:00.047117 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:00.047076    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:01.054694 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:01.054645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" event={"ID":"74115c0e-798a-43fa-98ea-277e61225907","Type":"ContainerStarted","Data":"b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17"}
Sep 10 14:52:01.055105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:01.054729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" event={"ID":"74115c0e-798a-43fa-98ea-277e61225907","Type":"ContainerStarted","Data":"3ac35b04f92a18972e0adc0ee7248bec0a088aa6e7bd0c0a7fe9a7d26bcf866f"}
Sep 10 14:52:01.073799 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:01.073740    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" podStartSLOduration=2.07369465 podStartE2EDuration="2.07369465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:52:01.072102496 +0000 UTC m=+1435.536469044" watchObservedRunningTime="2026-09-10 14:52:01.07369465 +0000 UTC m=+1435.538061171"
Sep 10 14:52:01.766379 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:01.766337    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:01.771654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:01.771626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:02.061389 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:02.061305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:02.062363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:02.062343    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:06.767627 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:06.767591    2561 scope.go:117] "RemoveContainer" containerID="4e9fd16080ce6b5ee19e44600c004f56d788111510ef093a6f693dd46717dc2c"
Sep 10 14:52:18.128658 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.128600    2561 patch_prober.go:28] interesting pod/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": read tcp 10.134.0.2:51876->10.134.0.92:15021: read: connection reset by peer" start-of-body=
Sep 10 14:52:18.129338 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.128685    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": read tcp 10.134.0.2:51876->10.134.0.92:15021: read: connection reset by peer"
Sep 10 14:52:18.185782 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.185745    2561 generic.go:356] "Generic (PLEG): container finished" podID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerID="39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543" exitCode=0
Sep 10 14:52:18.185947 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.185815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" event={"ID":"1aa52adc-989d-4a97-ad59-ebd9d36d22f0","Type":"ContainerDied","Data":"39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543"}
Sep 10 14:52:18.186322 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.186308    2561 scope.go:117] "RemoveContainer" containerID="39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543"
Sep 10 14:52:18.187610 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.187579    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:18.187699 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.187650    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:18.187699 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:18.187681    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:19.194913 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:19.194877    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" event={"ID":"1aa52adc-989d-4a97-ad59-ebd9d36d22f0","Type":"ContainerStarted","Data":"299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f"}
Sep 10 14:52:20.124288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:20.124244    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:52:20.124504 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:20.124381    2561 patch_prober.go:28] interesting pod/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 10 14:52:20.124504 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:20.124426    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 10 14:52:21.123893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:21.123846    2561 patch_prober.go:28] interesting pod/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 10 14:52:21.124395 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:21.123918    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 10 14:52:22.123634 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:22.123587    2561 patch_prober.go:28] interesting pod/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 10 14:52:22.123867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:22.123664    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 10 14:52:23.124181 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:23.124142    2561 patch_prober.go:28] interesting pod/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 10 14:52:23.124784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:23.124745    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 10 14:52:24.124462 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:24.124415    2561 patch_prober.go:28] interesting pod/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 10 14:52:24.125102 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:24.124492    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 10 14:52:25.127114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:25.127081    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:52:25.127490 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:25.127470    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:52:25.128196 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:25.128174    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:52:30.979149 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:30.979109    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"]
Sep 10 14:52:30.983152 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:30.983132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"
Sep 10 14:52:30.986198 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:30.986172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:52:30.989765 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:30.989741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"]
Sep 10 14:52:31.014014 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:31.013985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367233be-6857-4136-b8b6-b673a1b617cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz\" (UID: \"367233be-6857-4136-b8b6-b673a1b617cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"
Sep 10 14:52:31.115412 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:31.115375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367233be-6857-4136-b8b6-b673a1b617cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz\" (UID: \"367233be-6857-4136-b8b6-b673a1b617cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"
Sep 10 14:52:31.116163 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:31.116136    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367233be-6857-4136-b8b6-b673a1b617cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz\" (UID: \"367233be-6857-4136-b8b6-b673a1b617cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"
Sep 10 14:52:31.296923 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:31.296829    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"
Sep 10 14:52:31.573609 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:31.573585    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"]
Sep 10 14:52:31.576279 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:52:31.576251    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367233be_6857_4136_b8b6_b673a1b617cb.slice/crio-204f53d4dc2d55d1b74f3b4246bfc53169f3d1052a20581282b59a50737dcef1 WatchSource:0}: Error finding container 204f53d4dc2d55d1b74f3b4246bfc53169f3d1052a20581282b59a50737dcef1: Status 404 returned error can't find the container with id 204f53d4dc2d55d1b74f3b4246bfc53169f3d1052a20581282b59a50737dcef1
Sep 10 14:52:32.297307 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:32.297215    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz" event={"ID":"367233be-6857-4136-b8b6-b673a1b617cb","Type":"ContainerStarted","Data":"4915950b71e8ad916ebc024065f9dcf2790abf3ddc390a2eda405ee7badf7fab"}
Sep 10 14:52:32.297307 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:32.297275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz" event={"ID":"367233be-6857-4136-b8b6-b673a1b617cb","Type":"ContainerStarted","Data":"204f53d4dc2d55d1b74f3b4246bfc53169f3d1052a20581282b59a50737dcef1"}
Sep 10 14:52:32.311230 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:32.311182    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz" podStartSLOduration=2.311165844 podStartE2EDuration="2.311165844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:52:32.31041679 +0000 UTC m=+1466.774783329" watchObservedRunningTime="2026-09-10 14:52:32.311165844 +0000 UTC m=+1466.775532362"
Sep 10 14:52:33.305377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:33.305341    2561 generic.go:356] "Generic (PLEG): container finished" podID="367233be-6857-4136-b8b6-b673a1b617cb" containerID="4915950b71e8ad916ebc024065f9dcf2790abf3ddc390a2eda405ee7badf7fab" exitCode=0
Sep 10 14:52:33.305764 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:33.305430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz" event={"ID":"367233be-6857-4136-b8b6-b673a1b617cb","Type":"ContainerDied","Data":"4915950b71e8ad916ebc024065f9dcf2790abf3ddc390a2eda405ee7badf7fab"}
Sep 10 14:52:34.453513 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:34.453486    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"
Sep 10 14:52:34.558269 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:34.558227    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367233be-6857-4136-b8b6-b673a1b617cb-maas-api-service-ca\") pod \"367233be-6857-4136-b8b6-b673a1b617cb\" (UID: \"367233be-6857-4136-b8b6-b673a1b617cb\") "
Sep 10 14:52:34.558610 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:34.558582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/367233be-6857-4136-b8b6-b673a1b617cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "367233be-6857-4136-b8b6-b673a1b617cb" (UID: "367233be-6857-4136-b8b6-b673a1b617cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:34.659778 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:34.659743    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367233be-6857-4136-b8b6-b673a1b617cb-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:35.319069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:35.319033    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"
Sep 10 14:52:35.319069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:35.319050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz" event={"ID":"367233be-6857-4136-b8b6-b673a1b617cb","Type":"ContainerDied","Data":"204f53d4dc2d55d1b74f3b4246bfc53169f3d1052a20581282b59a50737dcef1"}
Sep 10 14:52:35.319273 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:35.319100    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="204f53d4dc2d55d1b74f3b4246bfc53169f3d1052a20581282b59a50737dcef1"
Sep 10 14:52:46.791831 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:46.791789    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"]
Sep 10 14:52:46.792313 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:46.792054    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5" podUID="73a4a628-ea91-47c2-b849-e07b3680668a" containerName="payload-processing" containerID="cri-o://63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0" gracePeriod=30
Sep 10 14:52:46.956488 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:46.956421    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"]
Sep 10 14:52:46.960744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:46.960696    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6eb765-q5bgz"]
Sep 10 14:52:47.158234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.157893    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:52:47.215974 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.215929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73a4a628-ea91-47c2-b849-e07b3680668a-plugins-config-volume\") pod \"73a4a628-ea91-47c2-b849-e07b3680668a\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") "
Sep 10 14:52:47.216177 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.216123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npxlx\" (UniqueName: \"kubernetes.io/projected/73a4a628-ea91-47c2-b849-e07b3680668a-kube-api-access-npxlx\") pod \"73a4a628-ea91-47c2-b849-e07b3680668a\" (UID: \"73a4a628-ea91-47c2-b849-e07b3680668a\") "
Sep 10 14:52:47.216687 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.216644    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a4a628-ea91-47c2-b849-e07b3680668a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "73a4a628-ea91-47c2-b849-e07b3680668a" (UID: "73a4a628-ea91-47c2-b849-e07b3680668a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:47.218564 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.218540    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a4a628-ea91-47c2-b849-e07b3680668a-kube-api-access-npxlx" (OuterVolumeSpecName: "kube-api-access-npxlx") pod "73a4a628-ea91-47c2-b849-e07b3680668a" (UID: "73a4a628-ea91-47c2-b849-e07b3680668a"). InnerVolumeSpecName "kube-api-access-npxlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:52:47.318162 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.317986    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npxlx\" (UniqueName: \"kubernetes.io/projected/73a4a628-ea91-47c2-b849-e07b3680668a-kube-api-access-npxlx\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:47.318162 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.318025    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73a4a628-ea91-47c2-b849-e07b3680668a-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:47.408971 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.408934    2561 generic.go:356] "Generic (PLEG): container finished" podID="73a4a628-ea91-47c2-b849-e07b3680668a" containerID="63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0" exitCode=0
Sep 10 14:52:47.409169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.409032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5" event={"ID":"73a4a628-ea91-47c2-b849-e07b3680668a","Type":"ContainerDied","Data":"63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0"}
Sep 10 14:52:47.409169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.409092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5" event={"ID":"73a4a628-ea91-47c2-b849-e07b3680668a","Type":"ContainerDied","Data":"a932bc52eb4b3d86e9a18c2c5f4aff9b2b989e0446377f712b0f138a1419e42d"}
Sep 10 14:52:47.409169 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.409113    2561 scope.go:117] "RemoveContainer" containerID="63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0"
Sep 10 14:52:47.409342 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.409237    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"
Sep 10 14:52:47.434444 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.431056    2561 scope.go:117] "RemoveContainer" containerID="63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0"
Sep 10 14:52:47.434444 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:52:47.431507    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0\": container with ID starting with 63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0 not found: ID does not exist" containerID="63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0"
Sep 10 14:52:47.434444 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.431549    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0"} err="failed to get container status \"63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0\": rpc error: code = NotFound desc = could not find container \"63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0\": container with ID starting with 63219026116d35b47592f7e136e6afba1dc42fb7723ea9ad60520ad575210bd0 not found: ID does not exist"
Sep 10 14:52:47.439843 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.439806    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"]
Sep 10 14:52:47.442634 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.442611    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-6eb765-846bd8c69-vnfv5"]
Sep 10 14:52:47.996744 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.996693    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="367233be-6857-4136-b8b6-b673a1b617cb" path="/var/lib/kubelet/pods/367233be-6857-4136-b8b6-b673a1b617cb/volumes"
Sep 10 14:52:47.997161 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:47.997146    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a4a628-ea91-47c2-b849-e07b3680668a" path="/var/lib/kubelet/pods/73a4a628-ea91-47c2-b849-e07b3680668a/volumes"
Sep 10 14:52:51.443806 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:51.443766    2561 generic.go:356] "Generic (PLEG): container finished" podID="74115c0e-798a-43fa-98ea-277e61225907" containerID="b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17" exitCode=0
Sep 10 14:52:51.444337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:51.443839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" event={"ID":"74115c0e-798a-43fa-98ea-277e61225907","Type":"ContainerDied","Data":"b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17"}
Sep 10 14:52:51.444476 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:51.444458    2561 scope.go:117] "RemoveContainer" containerID="b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17"
Sep 10 14:52:51.447735 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:51.446856    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:51.447735 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:51.447037    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:51.447735 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:51.447144    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 14:52:52.453337 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:52.453297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" event={"ID":"74115c0e-798a-43fa-98ea-277e61225907","Type":"ContainerStarted","Data":"41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738"}
Sep 10 14:52:52.766759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:52.766626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:52.766994 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:52.766968    2561 patch_prober.go:28] interesting pod/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:52:52.767062 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:52.767039    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 14:52:53.680379 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:53.680339    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"]
Sep 10 14:52:53.680895 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:53.680602    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" containerID="cri-o://299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f" gracePeriod=30
Sep 10 14:52:53.767408 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:53.767370    2561 patch_prober.go:28] interesting pod/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:52:53.767584 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:53.767442    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 14:52:54.028674 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.028559    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"]
Sep 10 14:52:54.029494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.029461    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a4a628-ea91-47c2-b849-e07b3680668a" containerName="payload-processing"
Sep 10 14:52:54.029494 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.029495    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a4a628-ea91-47c2-b849-e07b3680668a" containerName="payload-processing"
Sep 10 14:52:54.029731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.029544    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367233be-6857-4136-b8b6-b673a1b617cb" containerName="revoke-keys"
Sep 10 14:52:54.029731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.029555    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="367233be-6857-4136-b8b6-b673a1b617cb" containerName="revoke-keys"
Sep 10 14:52:54.029731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.029690    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a4a628-ea91-47c2-b849-e07b3680668a" containerName="payload-processing"
Sep 10 14:52:54.029731 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.029722    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="367233be-6857-4136-b8b6-b673a1b617cb" containerName="revoke-keys"
Sep 10 14:52:54.032686 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.032660    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"
Sep 10 14:52:54.042924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.042887    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"]
Sep 10 14:52:54.043204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.043173    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:52:54.119311 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.119272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5f5990-2953-4e9a-a611-450038cbdc54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns\" (UID: \"aa5f5990-2953-4e9a-a611-450038cbdc54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"
Sep 10 14:52:54.221911 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.221000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5f5990-2953-4e9a-a611-450038cbdc54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns\" (UID: \"aa5f5990-2953-4e9a-a611-450038cbdc54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"
Sep 10 14:52:54.222217 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.221868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5f5990-2953-4e9a-a611-450038cbdc54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns\" (UID: \"aa5f5990-2953-4e9a-a611-450038cbdc54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"
Sep 10 14:52:54.359396 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.359309    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"
Sep 10 14:52:54.642788 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.638756    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"]
Sep 10 14:52:54.654027 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:52:54.653985    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5f5990_2953_4e9a_a611_450038cbdc54.slice/crio-50c730e19d517b1a8c468643ef325e36a7ec19788fbedb9a556dc11947fcec84 WatchSource:0}: Error finding container 50c730e19d517b1a8c468643ef325e36a7ec19788fbedb9a556dc11947fcec84: Status 404 returned error can't find the container with id 50c730e19d517b1a8c468643ef325e36a7ec19788fbedb9a556dc11947fcec84
Sep 10 14:52:54.767108 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.767063    2561 patch_prober.go:28] interesting pod/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:52:54.767599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:54.767132    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 14:52:55.132542 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:55.132493    2561 patch_prober.go:28] interesting pod/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 14:52:55.132914 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:55.132568    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:52:55.480293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:55.480244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns" event={"ID":"aa5f5990-2953-4e9a-a611-450038cbdc54","Type":"ContainerStarted","Data":"38bde01a3395b4d5606a4b49aeaae8188ad73d5421479a3c2e367cdb45b01150"}
Sep 10 14:52:55.480493 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:55.480315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns" event={"ID":"aa5f5990-2953-4e9a-a611-450038cbdc54","Type":"ContainerStarted","Data":"50c730e19d517b1a8c468643ef325e36a7ec19788fbedb9a556dc11947fcec84"}
Sep 10 14:52:55.497377 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:55.497323    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns" podStartSLOduration=1.497305224 podStartE2EDuration="1.497305224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:52:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:52:55.493737008 +0000 UTC m=+1489.958103527" watchObservedRunningTime="2026-09-10 14:52:55.497305224 +0000 UTC m=+1489.961671746"
Sep 10 14:52:55.767275 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:55.767239    2561 patch_prober.go:28] interesting pod/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:52:55.767656 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:55.767295    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 14:52:56.488810 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:56.488769    2561 generic.go:356] "Generic (PLEG): container finished" podID="aa5f5990-2953-4e9a-a611-450038cbdc54" containerID="38bde01a3395b4d5606a4b49aeaae8188ad73d5421479a3c2e367cdb45b01150" exitCode=0
Sep 10 14:52:56.489019 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:56.488863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns" event={"ID":"aa5f5990-2953-4e9a-a611-450038cbdc54","Type":"ContainerDied","Data":"38bde01a3395b4d5606a4b49aeaae8188ad73d5421479a3c2e367cdb45b01150"}
Sep 10 14:52:56.766814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:56.766697    2561 patch_prober.go:28] interesting pod/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:52:56.766814 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:56.766780    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 10 14:52:57.649942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:57.649914    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"
Sep 10 14:52:57.774804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:57.774670    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5f5990-2953-4e9a-a611-450038cbdc54-maas-api-service-ca\") pod \"aa5f5990-2953-4e9a-a611-450038cbdc54\" (UID: \"aa5f5990-2953-4e9a-a611-450038cbdc54\") "
Sep 10 14:52:57.775053 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:57.775026    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5f5990-2953-4e9a-a611-450038cbdc54-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa5f5990-2953-4e9a-a611-450038cbdc54" (UID: "aa5f5990-2953-4e9a-a611-450038cbdc54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:57.775314 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:57.775296    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5f5990-2953-4e9a-a611-450038cbdc54-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:57.790370 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:57.790337    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:57.790844 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:57.790819    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:57.791513 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:57.791494    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:52:58.505559 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:58.505530    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"
Sep 10 14:52:58.505559 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:58.505547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns" event={"ID":"aa5f5990-2953-4e9a-a611-450038cbdc54","Type":"ContainerDied","Data":"50c730e19d517b1a8c468643ef325e36a7ec19788fbedb9a556dc11947fcec84"}
Sep 10 14:52:58.505802 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:58.505600    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50c730e19d517b1a8c468643ef325e36a7ec19788fbedb9a556dc11947fcec84"
Sep 10 14:52:58.978430 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:58.978405    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:52:59.090423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090331    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-token\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.090423 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090371    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-envoy\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.090664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090447    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istiod-ca-cert\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.090664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090469    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-podinfo\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.090664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090507    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-socket\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.090664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090526    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-certs\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.090664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090561    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-credential-socket\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.090959 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090817    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:59.090959 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090915    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:59.090959 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz6xg\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-kube-api-access-fz6xg\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.091130 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090997    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-data\") pod \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\" (UID: \"1aa52adc-989d-4a97-ad59-ebd9d36d22f0\") "
Sep 10 14:52:59.091188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090924    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:59.091188 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.090988    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:59.091309 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.091207    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:59.091692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.091583    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.091692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.091611    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.091692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.091627    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.091692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.091641    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.091692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.091657    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.092893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.092845    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:59.093007 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.092935    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-kube-api-access-fz6xg" (OuterVolumeSpecName: "kube-api-access-fz6xg") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "kube-api-access-fz6xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:52:59.093122 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.093102    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:52:59.093165 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.093149    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1aa52adc-989d-4a97-ad59-ebd9d36d22f0" (UID: "1aa52adc-989d-4a97-ad59-ebd9d36d22f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:52:59.192452 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.192416    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.192452 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.192448    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz6xg\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-kube-api-access-fz6xg\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.192452 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.192459    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.192691 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.192468    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa52adc-989d-4a97-ad59-ebd9d36d22f0-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:52:59.513544 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.513509    2561 generic.go:356] "Generic (PLEG): container finished" podID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerID="299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f" exitCode=0
Sep 10 14:52:59.513758 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.513559    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"
Sep 10 14:52:59.513758 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.513594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" event={"ID":"1aa52adc-989d-4a97-ad59-ebd9d36d22f0","Type":"ContainerDied","Data":"299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f"}
Sep 10 14:52:59.513758 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.513648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf" event={"ID":"1aa52adc-989d-4a97-ad59-ebd9d36d22f0","Type":"ContainerDied","Data":"3a429ebdb4f68254bc7d021a28855aff7868d6232e9708a4636494116dd4dcf2"}
Sep 10 14:52:59.513758 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.513670    2561 scope.go:117] "RemoveContainer" containerID="299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f"
Sep 10 14:52:59.525665 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.525644    2561 scope.go:117] "RemoveContainer" containerID="39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543"
Sep 10 14:52:59.540957 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.540860    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"]
Sep 10 14:52:59.542013 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.541980    2561 scope.go:117] "RemoveContainer" containerID="299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f"
Sep 10 14:52:59.545107 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:52:59.545079    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f\": container with ID starting with 299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f not found: ID does not exist" containerID="299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f"
Sep 10 14:52:59.545238 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.545115    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f"} err="failed to get container status \"299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f\": rpc error: code = NotFound desc = could not find container \"299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f\": container with ID starting with 299ce7571907e4f9bd661b2897b62b6e0a4ffaa173bbf8af04403fded5c7e49f not found: ID does not exist"
Sep 10 14:52:59.545238 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.545136    2561 scope.go:117] "RemoveContainer" containerID="39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543"
Sep 10 14:52:59.545508 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:52:59.545482    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543\": container with ID starting with 39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543 not found: ID does not exist" containerID="39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543"
Sep 10 14:52:59.545578 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.545517    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543"} err="failed to get container status \"39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543\": rpc error: code = NotFound desc = could not find container \"39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543\": container with ID starting with 39af10e1042f7774adcda6671952a92ebdd449115f976f52c7a2de84fa1c3543 not found: ID does not exist"
Sep 10 14:52:59.547053 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.547026    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6eb765-openshift-default-64c899f8f4-r4zgf"]
Sep 10 14:52:59.995777 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:52:59.995743    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" path="/var/lib/kubelet/pods/1aa52adc-989d-4a97-ad59-ebd9d36d22f0/volumes"
Sep 10 14:53:06.803766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:06.803735    2561 scope.go:117] "RemoveContainer" containerID="4938a650bf1239340fdea5f43f46f681674e0bdf6da3539236b3d492c0e4565a"
Sep 10 14:53:06.813115 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:06.813088    2561 scope.go:117] "RemoveContainer" containerID="971b59031194f7550e0ddee8f00172cf9952ed92d3da9c18415b2d552de901d0"
Sep 10 14:53:09.685450 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:09.685410    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"]
Sep 10 14:53:09.687952 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:09.687928    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f1b717-qc4ns"]
Sep 10 14:53:10.003672 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:10.003583    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5f5990-2953-4e9a-a611-450038cbdc54" path="/var/lib/kubelet/pods/aa5f5990-2953-4e9a-a611-450038cbdc54/volumes"
Sep 10 14:53:15.928096 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:15.928057    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"]
Sep 10 14:53:15.928692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:15.928355    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy" containerID="cri-o://41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738" gracePeriod=30
Sep 10 14:53:16.280530 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.280452    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"]
Sep 10 14:53:16.281018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.281003    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy"
Sep 10 14:53:16.281069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.281020    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy"
Sep 10 14:53:16.281069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.281033    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5f5990-2953-4e9a-a611-450038cbdc54" containerName="revoke-keys"
Sep 10 14:53:16.281069 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.281039    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5f5990-2953-4e9a-a611-450038cbdc54" containerName="revoke-keys"
Sep 10 14:53:16.281163 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.281121    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy"
Sep 10 14:53:16.281163 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.281130    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5f5990-2953-4e9a-a611-450038cbdc54" containerName="revoke-keys"
Sep 10 14:53:16.281163 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.281136    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy"
Sep 10 14:53:16.286264 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.286241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"
Sep 10 14:53:16.288695 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.288671    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:53:16.290170 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.290145    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"]
Sep 10 14:53:16.406206 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.406164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a530343-1764-4400-a593-784765285524-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk\" (UID: \"4a530343-1764-4400-a593-784765285524\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"
Sep 10 14:53:16.507282 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.507236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a530343-1764-4400-a593-784765285524-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk\" (UID: \"4a530343-1764-4400-a593-784765285524\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"
Sep 10 14:53:16.508006 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.507986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a530343-1764-4400-a593-784765285524-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk\" (UID: \"4a530343-1764-4400-a593-784765285524\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"
Sep 10 14:53:16.599085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.599006    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"
Sep 10 14:53:16.873416 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:16.873384    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"]
Sep 10 14:53:16.874209 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:53:16.874181    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a530343_1764_4400_a593_784765285524.slice/crio-d5931d108a57717a854d4f7f1dd29258f9e2029e0e6e17412997bc873c4c58a0 WatchSource:0}: Error finding container d5931d108a57717a854d4f7f1dd29258f9e2029e0e6e17412997bc873c4c58a0: Status 404 returned error can't find the container with id d5931d108a57717a854d4f7f1dd29258f9e2029e0e6e17412997bc873c4c58a0
Sep 10 14:53:17.640845 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:17.640804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk" event={"ID":"4a530343-1764-4400-a593-784765285524","Type":"ContainerStarted","Data":"ef4b6888f75c162c38f86da3ac463c4b09a379f44d968878389b6b40f08cc08f"}
Sep 10 14:53:17.641218 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:17.640863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk" event={"ID":"4a530343-1764-4400-a593-784765285524","Type":"ContainerStarted","Data":"d5931d108a57717a854d4f7f1dd29258f9e2029e0e6e17412997bc873c4c58a0"}
Sep 10 14:53:17.658445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:17.658390    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk" podStartSLOduration=1.658376803 podStartE2EDuration="1.658376803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:53:17.655861786 +0000 UTC m=+1512.120228308" watchObservedRunningTime="2026-09-10 14:53:17.658376803 +0000 UTC m=+1512.122743324"
Sep 10 14:53:18.652006 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:18.651970    2561 generic.go:356] "Generic (PLEG): container finished" podID="4a530343-1764-4400-a593-784765285524" containerID="ef4b6888f75c162c38f86da3ac463c4b09a379f44d968878389b6b40f08cc08f" exitCode=0
Sep 10 14:53:18.652380 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:18.652050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk" event={"ID":"4a530343-1764-4400-a593-784765285524","Type":"ContainerDied","Data":"ef4b6888f75c162c38f86da3ac463c4b09a379f44d968878389b6b40f08cc08f"}
Sep 10 14:53:19.812501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:19.812474    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"
Sep 10 14:53:19.950095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:19.950014    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a530343-1764-4400-a593-784765285524-maas-api-service-ca\") pod \"4a530343-1764-4400-a593-784765285524\" (UID: \"4a530343-1764-4400-a593-784765285524\") "
Sep 10 14:53:19.950334 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:19.950309    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a530343-1764-4400-a593-784765285524-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a530343-1764-4400-a593-784765285524" (UID: "4a530343-1764-4400-a593-784765285524"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:53:20.051180 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:20.051144    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a530343-1764-4400-a593-784765285524-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:20.665470 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:20.665442    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"
Sep 10 14:53:20.665638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:20.665436    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk" event={"ID":"4a530343-1764-4400-a593-784765285524","Type":"ContainerDied","Data":"d5931d108a57717a854d4f7f1dd29258f9e2029e0e6e17412997bc873c4c58a0"}
Sep 10 14:53:20.665638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:20.665576    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5931d108a57717a854d4f7f1dd29258f9e2029e0e6e17412997bc873c4c58a0"
Sep 10 14:53:21.203966 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.203906    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:53:21.265759 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.265719    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74115c0e-798a-43fa-98ea-277e61225907-istio-podinfo\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.265944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.265857    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-credential-socket\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.265944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.265889    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw5wd\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-kube-api-access-zw5wd\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.265944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.265908    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-istio-token\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.265944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.265942    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-envoy\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.266171 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.265994    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-certs\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.266171 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266019    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-socket\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.266285 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266195    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:21.266342 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266291    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:21.266342 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266329    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:21.266446 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266397    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-data\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.266446 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266436    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74115c0e-798a-43fa-98ea-277e61225907-istiod-ca-cert\") pod \"74115c0e-798a-43fa-98ea-277e61225907\" (UID: \"74115c0e-798a-43fa-98ea-277e61225907\") "
Sep 10 14:53:21.266654 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-data" (OuterVolumeSpecName: "istio-data") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:21.266826 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.266806    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74115c0e-798a-43fa-98ea-277e61225907-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:53:21.267040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.267027    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.267040 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.267040    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.267164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.267050    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.267164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.267058    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.267164 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.267067    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74115c0e-798a-43fa-98ea-277e61225907-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.268165 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.268136    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74115c0e-798a-43fa-98ea-277e61225907-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:53:21.268280 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.268162    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-istio-token" (OuterVolumeSpecName: "istio-token") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:53:21.268456 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.268433    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-kube-api-access-zw5wd" (OuterVolumeSpecName: "kube-api-access-zw5wd") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "kube-api-access-zw5wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:53:21.268456 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.268441    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74115c0e-798a-43fa-98ea-277e61225907" (UID: "74115c0e-798a-43fa-98ea-277e61225907"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:21.367994 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.367965    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74115c0e-798a-43fa-98ea-277e61225907-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.367994 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.367991    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw5wd\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-kube-api-access-zw5wd\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.367994 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.368001    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74115c0e-798a-43fa-98ea-277e61225907-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.368221 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.368010    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74115c0e-798a-43fa-98ea-277e61225907-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:21.674021 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.673982    2561 generic.go:356] "Generic (PLEG): container finished" podID="74115c0e-798a-43fa-98ea-277e61225907" containerID="41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738" exitCode=0
Sep 10 14:53:21.674208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.674029    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"
Sep 10 14:53:21.674208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.674062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" event={"ID":"74115c0e-798a-43fa-98ea-277e61225907","Type":"ContainerDied","Data":"41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738"}
Sep 10 14:53:21.674208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.674120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq" event={"ID":"74115c0e-798a-43fa-98ea-277e61225907","Type":"ContainerDied","Data":"3ac35b04f92a18972e0adc0ee7248bec0a088aa6e7bd0c0a7fe9a7d26bcf866f"}
Sep 10 14:53:21.674208 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.674149    2561 scope.go:117] "RemoveContainer" containerID="41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738"
Sep 10 14:53:21.684526 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.684505    2561 scope.go:117] "RemoveContainer" containerID="b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17"
Sep 10 14:53:21.693844 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.693825    2561 scope.go:117] "RemoveContainer" containerID="41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738"
Sep 10 14:53:21.694157 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:21.694138    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738\": container with ID starting with 41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738 not found: ID does not exist" containerID="41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738"
Sep 10 14:53:21.694219 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.694166    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738"} err="failed to get container status \"41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738\": rpc error: code = NotFound desc = could not find container \"41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738\": container with ID starting with 41d003819d2cf636562236eb4d93d0ed4d38b2417f64bfa2dad13ec873a5b738 not found: ID does not exist"
Sep 10 14:53:21.694219 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.694185    2561 scope.go:117] "RemoveContainer" containerID="b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17"
Sep 10 14:53:21.694442 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:21.694428    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17\": container with ID starting with b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17 not found: ID does not exist" containerID="b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17"
Sep 10 14:53:21.694486 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.694444    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17"} err="failed to get container status \"b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17\": rpc error: code = NotFound desc = could not find container \"b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17\": container with ID starting with b1e9962ed808a1fed603987c2f0f85b359299e41ca4d7773b9ab5bb3cc4b4c17 not found: ID does not exist"
Sep 10 14:53:21.696304 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.696285    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"]
Sep 10 14:53:21.700905 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.700884    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f1b717-openshift-default-78fb46986b-p6znq"]
Sep 10 14:53:21.996344 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:21.996264    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74115c0e-798a-43fa-98ea-277e61225907" path="/var/lib/kubelet/pods/74115c0e-798a-43fa-98ea-277e61225907/volumes"
Sep 10 14:53:27.228529 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:27.228489    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"]
Sep 10 14:53:27.231179 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:27.231152    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-5c9641-h2jrk"]
Sep 10 14:53:27.995886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:27.995844    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a530343-1764-4400-a593-784765285524" path="/var/lib/kubelet/pods/4a530343-1764-4400-a593-784765285524/volumes"
Sep 10 14:53:33.454983 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.454945    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"]
Sep 10 14:53:33.455387 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.455217    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy" containerID="cri-o://43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490" gracePeriod=30
Sep 10 14:53:33.830285 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830179    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"]
Sep 10 14:53:33.830824 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830804    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a530343-1764-4400-a593-784765285524" containerName="revoke-keys"
Sep 10 14:53:33.830824 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830825    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a530343-1764-4400-a593-784765285524" containerName="revoke-keys"
Sep 10 14:53:33.830993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830856    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy"
Sep 10 14:53:33.830993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830865    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy"
Sep 10 14:53:33.830993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830877    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy"
Sep 10 14:53:33.830993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830885    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa52adc-989d-4a97-ad59-ebd9d36d22f0" containerName="istio-proxy"
Sep 10 14:53:33.830993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830915    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy"
Sep 10 14:53:33.830993 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.830923    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy"
Sep 10 14:53:33.831288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.831056    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy"
Sep 10 14:53:33.831288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.831067    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="74115c0e-798a-43fa-98ea-277e61225907" containerName="istio-proxy"
Sep 10 14:53:33.831288 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.831080    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a530343-1764-4400-a593-784765285524" containerName="revoke-keys"
Sep 10 14:53:33.836105 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.836082    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"
Sep 10 14:53:33.838751 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.838730    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:53:33.841042 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.841018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"]
Sep 10 14:53:33.916463 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:33.916425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3ad817b-26c5-4ee9-bc5d-efe340f53fb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g\" (UID: \"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"
Sep 10 14:53:34.017256 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:34.017219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3ad817b-26c5-4ee9-bc5d-efe340f53fb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g\" (UID: \"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"
Sep 10 14:53:34.017893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:34.017872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3ad817b-26c5-4ee9-bc5d-efe340f53fb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g\" (UID: \"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"
Sep 10 14:53:34.149429 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:34.149394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"
Sep 10 14:53:34.422897 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:34.422868    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"]
Sep 10 14:53:34.425270 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:53:34.425224    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ad817b_26c5_4ee9_bc5d_efe340f53fb7.slice/crio-242daa50cbdd7daa51d5d0f4d1b6c1c6243a4f6bd3b5c74f3e02d61306de0e76 WatchSource:0}: Error finding container 242daa50cbdd7daa51d5d0f4d1b6c1c6243a4f6bd3b5c74f3e02d61306de0e76: Status 404 returned error can't find the container with id 242daa50cbdd7daa51d5d0f4d1b6c1c6243a4f6bd3b5c74f3e02d61306de0e76
Sep 10 14:53:34.757252 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:34.757222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g" event={"ID":"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7","Type":"ContainerStarted","Data":"2dd4abfad35ad442e93d51b1faeab98e2dca833c79e0be165826a75cdba41338"}
Sep 10 14:53:34.757624 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:34.757276    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g" event={"ID":"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7","Type":"ContainerStarted","Data":"242daa50cbdd7daa51d5d0f4d1b6c1c6243a4f6bd3b5c74f3e02d61306de0e76"}
Sep 10 14:53:34.775018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:34.774973    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g" podStartSLOduration=1.774957465 podStartE2EDuration="1.774957465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:53:34.772324437 +0000 UTC m=+1529.236690963" watchObservedRunningTime="2026-09-10 14:53:34.774957465 +0000 UTC m=+1529.239323996"
Sep 10 14:53:35.765172 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:35.765136    2561 generic.go:356] "Generic (PLEG): container finished" podID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerID="f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b" exitCode=137
Sep 10 14:53:35.765549 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:35.765203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerDied","Data":"f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"}
Sep 10 14:53:35.765549 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:35.765291    2561 scope.go:117] "RemoveContainer" containerID="63aea0c4846d2e9f1a2385401cc932cfeff7fff781b082fb1683e8708e9cfc3d"
Sep 10 14:53:35.765718 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:35.765688    2561 scope.go:117] "RemoveContainer" containerID="f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"
Sep 10 14:53:35.766039 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:35.766015    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-5769f99d9f-6ckfx_kuadrant-system(187c4f77-1bd2-425e-a1aa-648dcc6e8713)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713"
Sep 10 14:53:35.767442 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:35.767410    2561 generic.go:356] "Generic (PLEG): container finished" podID="b3ad817b-26c5-4ee9-bc5d-efe340f53fb7" containerID="2dd4abfad35ad442e93d51b1faeab98e2dca833c79e0be165826a75cdba41338" exitCode=0
Sep 10 14:53:35.767513 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:35.767475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g" event={"ID":"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7","Type":"ContainerDied","Data":"2dd4abfad35ad442e93d51b1faeab98e2dca833c79e0be165826a75cdba41338"}
Sep 10 14:53:36.923443 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:36.923417    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"
Sep 10 14:53:36.943663 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:36.943626    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3ad817b-26c5-4ee9-bc5d-efe340f53fb7-maas-api-service-ca\") pod \"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7\" (UID: \"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7\") "
Sep 10 14:53:36.944018 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:36.943992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3ad817b-26c5-4ee9-bc5d-efe340f53fb7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3ad817b-26c5-4ee9-bc5d-efe340f53fb7" (UID: "b3ad817b-26c5-4ee9-bc5d-efe340f53fb7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:53:36.944167 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:36.944152    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3ad817b-26c5-4ee9-bc5d-efe340f53fb7-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:37.791431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:37.791395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g" event={"ID":"b3ad817b-26c5-4ee9-bc5d-efe340f53fb7","Type":"ContainerDied","Data":"242daa50cbdd7daa51d5d0f4d1b6c1c6243a4f6bd3b5c74f3e02d61306de0e76"}
Sep 10 14:53:37.791638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:37.791451    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"
Sep 10 14:53:37.791638 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:37.791471    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="242daa50cbdd7daa51d5d0f4d1b6c1c6243a4f6bd3b5c74f3e02d61306de0e76"
Sep 10 14:53:38.098394 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.098301    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:53:38.098394 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.098369    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:53:38.721746 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.721649    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:53:38.766044 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766009    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-socket\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766211 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istiod-ca-cert\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766211 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-envoy\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766350 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766237    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-token\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766350 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766287    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-data\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766350 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766345    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-credential-socket\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766321    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:38.766501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766370    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-podinfo\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766396    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqfhg\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-kube-api-access-hqfhg\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766501 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-certs\") pod \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\" (UID: \"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e\") "
Sep 10 14:53:38.766729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766549    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:38.766729 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766575    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:53:38.766854 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.766798    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:38.767178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.767014    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.767178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.767039    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.767178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.767054    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.767178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.767067    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.767178 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.767143    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:38.768667 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.768641    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:53:38.768911 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.768890    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-kube-api-access-hqfhg" (OuterVolumeSpecName: "kube-api-access-hqfhg") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "kube-api-access-hqfhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:53:38.768985 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.768954    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:38.769085 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.769060    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" (UID: "1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:53:38.799893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.799857    2561 generic.go:356] "Generic (PLEG): container finished" podID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerID="43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490" exitCode=0
Sep 10 14:53:38.800051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.799912    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"
Sep 10 14:53:38.800051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.799945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" event={"ID":"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e","Type":"ContainerDied","Data":"43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490"}
Sep 10 14:53:38.800051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.800009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx" event={"ID":"1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e","Type":"ContainerDied","Data":"abac69d9a3728d0daa896345e41ececef14aee63b0d9a388c6565ef7bc8795db"}
Sep 10 14:53:38.800051 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.800036    2561 scope.go:117] "RemoveContainer" containerID="43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490"
Sep 10 14:53:38.810463 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.810444    2561 scope.go:117] "RemoveContainer" containerID="fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd"
Sep 10 14:53:38.819393 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.819369    2561 scope.go:117] "RemoveContainer" containerID="43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490"
Sep 10 14:53:38.819776 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:38.819738    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490\": container with ID starting with 43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490 not found: ID does not exist" containerID="43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490"
Sep 10 14:53:38.819875 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.819786    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490"} err="failed to get container status \"43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490\": rpc error: code = NotFound desc = could not find container \"43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490\": container with ID starting with 43a598f24011449291d279d5e307f83aadabe311e766fc39a75980824bd2b490 not found: ID does not exist"
Sep 10 14:53:38.819875 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.819811    2561 scope.go:117] "RemoveContainer" containerID="fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd"
Sep 10 14:53:38.820125 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:38.820098    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd\": container with ID starting with fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd not found: ID does not exist" containerID="fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd"
Sep 10 14:53:38.820243 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.820134    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd"} err="failed to get container status \"fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd\": rpc error: code = NotFound desc = could not find container \"fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd\": container with ID starting with fc8d0456487667455e96ef96bc1ab58dbf3916d51b779e9f8eee31cd79b0cbbd not found: ID does not exist"
Sep 10 14:53:38.823577 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.823550    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"]
Sep 10 14:53:38.829263 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.829242    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5c9641-openshift-default-7f44fb69d6-vm6vx"]
Sep 10 14:53:38.868415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.868375    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.868415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.868408    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.868415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.868418    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.868641 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.868427    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:38.868641 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:38.868439    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqfhg\" (UniqueName: \"kubernetes.io/projected/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e-kube-api-access-hqfhg\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:39.995558 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:39.995519    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" path="/var/lib/kubelet/pods/1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e/volumes"
Sep 10 14:53:40.583766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:40.583729    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:53:40.584126 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:40.584111    2561 scope.go:117] "RemoveContainer" containerID="f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"
Sep 10 14:53:40.584374 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:40.584354    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-5769f99d9f-6ckfx_kuadrant-system(187c4f77-1bd2-425e-a1aa-648dcc6e8713)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713"
Sep 10 14:53:44.372213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.372171    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"]
Sep 10 14:53:44.372693 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.372448    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf" podUID="b27d482c-e327-431b-ba22-d89f841e5a50" containerName="payload-pre-processing" containerID="cri-o://985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f" gracePeriod=30
Sep 10 14:53:44.525940 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.525904    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"]
Sep 10 14:53:44.528461 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.528427    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-ecfa25-r292g"]
Sep 10 14:53:44.638363 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.638287    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:53:44.739070 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.739028    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls8w5\" (UniqueName: \"kubernetes.io/projected/b27d482c-e327-431b-ba22-d89f841e5a50-kube-api-access-ls8w5\") pod \"b27d482c-e327-431b-ba22-d89f841e5a50\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") "
Sep 10 14:53:44.739264 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.739081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27d482c-e327-431b-ba22-d89f841e5a50-plugins-config-volume\") pod \"b27d482c-e327-431b-ba22-d89f841e5a50\" (UID: \"b27d482c-e327-431b-ba22-d89f841e5a50\") "
Sep 10 14:53:44.739499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.739476    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27d482c-e327-431b-ba22-d89f841e5a50-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b27d482c-e327-431b-ba22-d89f841e5a50" (UID: "b27d482c-e327-431b-ba22-d89f841e5a50"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:53:44.741160 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.741134    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27d482c-e327-431b-ba22-d89f841e5a50-kube-api-access-ls8w5" (OuterVolumeSpecName: "kube-api-access-ls8w5") pod "b27d482c-e327-431b-ba22-d89f841e5a50" (UID: "b27d482c-e327-431b-ba22-d89f841e5a50"). InnerVolumeSpecName "kube-api-access-ls8w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:53:44.840322 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.840282    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls8w5\" (UniqueName: \"kubernetes.io/projected/b27d482c-e327-431b-ba22-d89f841e5a50-kube-api-access-ls8w5\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:44.840322 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.840319    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b27d482c-e327-431b-ba22-d89f841e5a50-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:44.840553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.840339    2561 generic.go:356] "Generic (PLEG): container finished" podID="b27d482c-e327-431b-ba22-d89f841e5a50" containerID="985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f" exitCode=0
Sep 10 14:53:44.840553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.840403    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"
Sep 10 14:53:44.840553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.840411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf" event={"ID":"b27d482c-e327-431b-ba22-d89f841e5a50","Type":"ContainerDied","Data":"985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f"}
Sep 10 14:53:44.840553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.840484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf" event={"ID":"b27d482c-e327-431b-ba22-d89f841e5a50","Type":"ContainerDied","Data":"0e0b2c12ccd179d62b41e89163c80449fc7d75bef0b40ad2d3106365e32b28ac"}
Sep 10 14:53:44.840553 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.840517    2561 scope.go:117] "RemoveContainer" containerID="985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f"
Sep 10 14:53:44.852248 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.852222    2561 scope.go:117] "RemoveContainer" containerID="985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f"
Sep 10 14:53:44.852657 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:44.852627    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f\": container with ID starting with 985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f not found: ID does not exist" containerID="985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f"
Sep 10 14:53:44.852815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.852663    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f"} err="failed to get container status \"985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f\": rpc error: code = NotFound desc = could not find container \"985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f\": container with ID starting with 985b60a8ccb580a107b565a59e075b0133bdc71bcd9646a6f2d2ea4e60048c6f not found: ID does not exist"
Sep 10 14:53:44.863892 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.863862    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"]
Sep 10 14:53:44.867460 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:44.867433    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ecfa25-bd5f45466-bmfhf"]
Sep 10 14:53:45.997652 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:45.997613    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27d482c-e327-431b-ba22-d89f841e5a50" path="/var/lib/kubelet/pods/b27d482c-e327-431b-ba22-d89f841e5a50/volumes"
Sep 10 14:53:45.998057 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:45.998035    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3ad817b-26c5-4ee9-bc5d-efe340f53fb7" path="/var/lib/kubelet/pods/b3ad817b-26c5-4ee9-bc5d-efe340f53fb7/volumes"
Sep 10 14:53:49.205512 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:49.205476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:53:49.205967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:49.205913    2561 scope.go:117] "RemoveContainer" containerID="f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"
Sep 10 14:53:49.875591 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:49.875554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerStarted","Data":"99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a"}
Sep 10 14:53:49.875864 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:49.875848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:53:51.002415 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:51.002370    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"]
Sep 10 14:53:51.002922 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:51.002581    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy" containerID="cri-o://af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52" gracePeriod=30
Sep 10 14:53:56.274602 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.274529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:53:56.379985 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.379941    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-certs\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.379997    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-podinfo\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380029    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-socket\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-data\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380103    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-credential-socket\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380142    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-token\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380187 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380177    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94582bc-a5a5-4b7d-860c-846716ae30ec-istiod-ca-cert\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380235    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brgbg\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-kube-api-access-brgbg\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380287    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-envoy\") pod \"f94582bc-a5a5-4b7d-860c-846716ae30ec\" (UID: \"f94582bc-a5a5-4b7d-860c-846716ae30ec\") "
Sep 10 14:53:56.380516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380338    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:56.380516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:56.380766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94582bc-a5a5-4b7d-860c-846716ae30ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:53:56.380766 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380625    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:56.380875 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.380771    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:56.381035 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.381015    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.381103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.381041    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.381103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.381056    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.381103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.381072    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.381103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.381085    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94582bc-a5a5-4b7d-860c-846716ae30ec-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.382310 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.382283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:53:56.382537 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.382511    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-kube-api-access-brgbg" (OuterVolumeSpecName: "kube-api-access-brgbg") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "kube-api-access-brgbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:53:56.382600 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.382556    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:53:56.382639 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.382601    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f94582bc-a5a5-4b7d-860c-846716ae30ec" (UID: "f94582bc-a5a5-4b7d-860c-846716ae30ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:53:56.481791 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.481748    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.481791 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.481783    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.481791 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.481794    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brgbg\" (UniqueName: \"kubernetes.io/projected/f94582bc-a5a5-4b7d-860c-846716ae30ec-kube-api-access-brgbg\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.481791 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.481804    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94582bc-a5a5-4b7d-860c-846716ae30ec-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:53:56.921404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.921370    2561 generic.go:356] "Generic (PLEG): container finished" podID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerID="af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52" exitCode=0
Sep 10 14:53:56.921574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.921421    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"
Sep 10 14:53:56.921574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.921453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" event={"ID":"f94582bc-a5a5-4b7d-860c-846716ae30ec","Type":"ContainerDied","Data":"af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52"}
Sep 10 14:53:56.921574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.921508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx" event={"ID":"f94582bc-a5a5-4b7d-860c-846716ae30ec","Type":"ContainerDied","Data":"16cb39222c04a17c4a19ca83e9c8f3872fba89e95a498546d5a1a9edc86e92a2"}
Sep 10 14:53:56.921574 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.921531    2561 scope.go:117] "RemoveContainer" containerID="af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52"
Sep 10 14:53:56.932117 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.932096    2561 scope.go:117] "RemoveContainer" containerID="855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641"
Sep 10 14:53:56.942442 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.942411    2561 scope.go:117] "RemoveContainer" containerID="af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52"
Sep 10 14:53:56.943225 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:56.943075    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52\": container with ID starting with af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52 not found: ID does not exist" containerID="af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52"
Sep 10 14:53:56.943225 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.943113    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52"} err="failed to get container status \"af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52\": rpc error: code = NotFound desc = could not find container \"af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52\": container with ID starting with af8d88a85749851cc4bd844ef4d7e416c9f09c35e7c6d1c769bdc8707a8f2e52 not found: ID does not exist"
Sep 10 14:53:56.943225 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.943147    2561 scope.go:117] "RemoveContainer" containerID="855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641"
Sep 10 14:53:56.943501 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:53:56.943481    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641\": container with ID starting with 855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641 not found: ID does not exist" containerID="855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641"
Sep 10 14:53:56.943546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.943508    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641"} err="failed to get container status \"855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641\": rpc error: code = NotFound desc = could not find container \"855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641\": container with ID starting with 855160a2ccb8ea12d47b731fe1679211e3497a417cf050878e6aee87c4f67641 not found: ID does not exist"
Sep 10 14:53:56.944867 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.944849    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"]
Sep 10 14:53:56.947581 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:56.947562    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-ecfa25-openshift-default-7d7d54d94d-vh6xx"]
Sep 10 14:53:57.994419 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:53:57.994380    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" path="/var/lib/kubelet/pods/f94582bc-a5a5-4b7d-860c-846716ae30ec/volumes"
Sep 10 14:54:00.884439 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:54:00.884411    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 14:55:52.500909 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.500875    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"]
Sep 10 14:55:52.501404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501353    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy"
Sep 10 14:55:52.501404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501366    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy"
Sep 10 14:55:52.501404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501383    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy"
Sep 10 14:55:52.501404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501388    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy"
Sep 10 14:55:52.501404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501400    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy"
Sep 10 14:55:52.501404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501406    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501414    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ad817b-26c5-4ee9-bc5d-efe340f53fb7" containerName="revoke-keys"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501420    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ad817b-26c5-4ee9-bc5d-efe340f53fb7" containerName="revoke-keys"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501429    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501435    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501450    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27d482c-e327-431b-ba22-d89f841e5a50" containerName="payload-pre-processing"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501455    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27d482c-e327-431b-ba22-d89f841e5a50" containerName="payload-pre-processing"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501529    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501536    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae10dc3-a30e-4456-ba9d-fb4fb1420d8e" containerName="istio-proxy"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501545    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501552    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3ad817b-26c5-4ee9-bc5d-efe340f53fb7" containerName="revoke-keys"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501559    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f94582bc-a5a5-4b7d-860c-846716ae30ec" containerName="istio-proxy"
Sep 10 14:55:52.501607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.501565    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27d482c-e327-431b-ba22-d89f841e5a50" containerName="payload-pre-processing"
Sep 10 14:55:52.504947 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.504929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"
Sep 10 14:55:52.507995 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.507973    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:55:52.529607 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.529577    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"]
Sep 10 14:55:52.608539 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.608494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95f51852-06a4-4600-aace-4b9c7aedb27f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95\" (UID: \"95f51852-06a4-4600-aace-4b9c7aedb27f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"
Sep 10 14:55:52.709517 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.709482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95f51852-06a4-4600-aace-4b9c7aedb27f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95\" (UID: \"95f51852-06a4-4600-aace-4b9c7aedb27f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"
Sep 10 14:55:52.710127 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.710107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95f51852-06a4-4600-aace-4b9c7aedb27f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95\" (UID: \"95f51852-06a4-4600-aace-4b9c7aedb27f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"
Sep 10 14:55:52.815193 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:52.815003    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"
Sep 10 14:55:53.116427 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:53.116400    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"]
Sep 10 14:55:53.117669 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:55:53.117640    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f51852_06a4_4600_aace_4b9c7aedb27f.slice/crio-594a2f7a34d34381baadbc931632543d562954eeff69492a0c6311eac5779b0b WatchSource:0}: Error finding container 594a2f7a34d34381baadbc931632543d562954eeff69492a0c6311eac5779b0b: Status 404 returned error can't find the container with id 594a2f7a34d34381baadbc931632543d562954eeff69492a0c6311eac5779b0b
Sep 10 14:55:53.662095 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:53.662057    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95" event={"ID":"95f51852-06a4-4600-aace-4b9c7aedb27f","Type":"ContainerStarted","Data":"7ca6a6623700b9408960f75e6dbf250828862ee03e40f47614cb12b9bb1cba3c"}
Sep 10 14:55:53.662486 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:53.662117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95" event={"ID":"95f51852-06a4-4600-aace-4b9c7aedb27f","Type":"ContainerStarted","Data":"594a2f7a34d34381baadbc931632543d562954eeff69492a0c6311eac5779b0b"}
Sep 10 14:55:53.724912 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:53.724805    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95" podStartSLOduration=1.724789506 podStartE2EDuration="1.724789506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:55:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:55:53.724756577 +0000 UTC m=+1668.189123099" watchObservedRunningTime="2026-09-10 14:55:53.724789506 +0000 UTC m=+1668.189156028"
Sep 10 14:55:54.677784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:54.677752    2561 generic.go:356] "Generic (PLEG): container finished" podID="95f51852-06a4-4600-aace-4b9c7aedb27f" containerID="7ca6a6623700b9408960f75e6dbf250828862ee03e40f47614cb12b9bb1cba3c" exitCode=0
Sep 10 14:55:54.678219 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:54.677840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95" event={"ID":"95f51852-06a4-4600-aace-4b9c7aedb27f","Type":"ContainerDied","Data":"7ca6a6623700b9408960f75e6dbf250828862ee03e40f47614cb12b9bb1cba3c"}
Sep 10 14:55:55.829748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:55.829697    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"
Sep 10 14:55:55.845773 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:55.845743    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95f51852-06a4-4600-aace-4b9c7aedb27f-maas-api-service-ca\") pod \"95f51852-06a4-4600-aace-4b9c7aedb27f\" (UID: \"95f51852-06a4-4600-aace-4b9c7aedb27f\") "
Sep 10 14:55:55.846161 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:55.846136    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95f51852-06a4-4600-aace-4b9c7aedb27f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "95f51852-06a4-4600-aace-4b9c7aedb27f" (UID: "95f51852-06a4-4600-aace-4b9c7aedb27f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:55:55.846268 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:55.846253    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95f51852-06a4-4600-aace-4b9c7aedb27f-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:55:56.691535 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:56.691500    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"
Sep 10 14:55:56.691769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:56.691532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95" event={"ID":"95f51852-06a4-4600-aace-4b9c7aedb27f","Type":"ContainerDied","Data":"594a2f7a34d34381baadbc931632543d562954eeff69492a0c6311eac5779b0b"}
Sep 10 14:55:56.691769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:56.691595    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="594a2f7a34d34381baadbc931632543d562954eeff69492a0c6311eac5779b0b"
Sep 10 14:55:57.393622 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:55:57.393571    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"]
Sep 10 14:56:06.889067 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:06.889024    2561 scope.go:117] "RemoveContainer" containerID="ca68c4ffdfe149e5cb8cd3d5e35ccfec8f259936247c12e20488b62cd4dc445c"
Sep 10 14:56:09.244972 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:09.244925    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"]
Sep 10 14:56:09.249091 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:09.249053    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-9b1e67-29817525-9kjbp"]
Sep 10 14:56:09.839296 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:09.839260    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"]
Sep 10 14:56:09.849889 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:09.849857    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-9b1e67-lgc95"]
Sep 10 14:56:09.994877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:09.994841    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9ef369-4f0b-49c8-9e44-816c2f93afce" path="/var/lib/kubelet/pods/2e9ef369-4f0b-49c8-9e44-816c2f93afce/volumes"
Sep 10 14:56:09.995293 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:09.995272    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95f51852-06a4-4600-aace-4b9c7aedb27f" path="/var/lib/kubelet/pods/95f51852-06a4-4600-aace-4b9c7aedb27f/volumes"
Sep 10 14:56:12.413843 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.413802    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6" podUID="a4c1d322-e38f-446a-a1a5-2d7c46361a70" containerName="main" containerID="cri-o://af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126" gracePeriod=45
Sep 10 14:56:12.677696 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.677630    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:56:12.801380 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.801337    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4c1d322-e38f-446a-a1a5-2d7c46361a70" containerID="af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126" exitCode=0
Sep 10 14:56:12.801557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.801391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6" event={"ID":"a4c1d322-e38f-446a-a1a5-2d7c46361a70","Type":"ContainerDied","Data":"af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126"}
Sep 10 14:56:12.801557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.801427    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"
Sep 10 14:56:12.801557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.801442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6" event={"ID":"a4c1d322-e38f-446a-a1a5-2d7c46361a70","Type":"ContainerDied","Data":"fb6dba5ee9b04b5a326084d4e1ac1905f2878e316eb9f4c9c81ec8b15515a2e1"}
Sep 10 14:56:12.801557 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.801462    2561 scope.go:117] "RemoveContainer" containerID="af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126"
Sep 10 14:56:12.811146 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.811127    2561 scope.go:117] "RemoveContainer" containerID="af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126"
Sep 10 14:56:12.811491 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:56:12.811469    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126\": container with ID starting with af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126 not found: ID does not exist" containerID="af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126"
Sep 10 14:56:12.811591 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.811498    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126"} err="failed to get container status \"af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126\": rpc error: code = NotFound desc = could not find container \"af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126\": container with ID starting with af4e3bc21aba91bc6166785ad59dfd5d23d02a19ba876c76bd8922ac8832d126 not found: ID does not exist"
Sep 10 14:56:12.843067 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843034    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-home\") pod \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") "
Sep 10 14:56:12.843234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tls-certs\") pod \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") "
Sep 10 14:56:12.843234 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843126    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tmp-dir\") pod \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") "
Sep 10 14:56:12.843349 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843296    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbz75\" (UniqueName: \"kubernetes.io/projected/a4c1d322-e38f-446a-a1a5-2d7c46361a70-kube-api-access-qbz75\") pod \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") "
Sep 10 14:56:12.843349 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843294    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-home" (OuterVolumeSpecName: "home") pod "a4c1d322-e38f-446a-a1a5-2d7c46361a70" (UID: "a4c1d322-e38f-446a-a1a5-2d7c46361a70"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:12.843459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-dshm\") pod \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") "
Sep 10 14:56:12.843459 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843446    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a4c1d322-e38f-446a-a1a5-2d7c46361a70" (UID: "a4c1d322-e38f-446a-a1a5-2d7c46361a70"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:12.843565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-model-cache\") pod \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\" (UID: \"a4c1d322-e38f-446a-a1a5-2d7c46361a70\") "
Sep 10 14:56:12.843748 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.843723    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-model-cache" (OuterVolumeSpecName: "model-cache") pod "a4c1d322-e38f-446a-a1a5-2d7c46361a70" (UID: "a4c1d322-e38f-446a-a1a5-2d7c46361a70"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:12.844047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.844023    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:12.844150 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.844047    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:12.844150 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.844059    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:12.845511 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.845480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-dshm" (OuterVolumeSpecName: "dshm") pod "a4c1d322-e38f-446a-a1a5-2d7c46361a70" (UID: "a4c1d322-e38f-446a-a1a5-2d7c46361a70"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:12.845606 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.845582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c1d322-e38f-446a-a1a5-2d7c46361a70-kube-api-access-qbz75" (OuterVolumeSpecName: "kube-api-access-qbz75") pod "a4c1d322-e38f-446a-a1a5-2d7c46361a70" (UID: "a4c1d322-e38f-446a-a1a5-2d7c46361a70"). InnerVolumeSpecName "kube-api-access-qbz75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:56:12.845664 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.845647    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a4c1d322-e38f-446a-a1a5-2d7c46361a70" (UID: "a4c1d322-e38f-446a-a1a5-2d7c46361a70"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:56:12.945509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.945421    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c1d322-e38f-446a-a1a5-2d7c46361a70-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:12.945509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.945453    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbz75\" (UniqueName: \"kubernetes.io/projected/a4c1d322-e38f-446a-a1a5-2d7c46361a70-kube-api-access-qbz75\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:12.945509 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:12.945463    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4c1d322-e38f-446a-a1a5-2d7c46361a70-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:13.157770 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:13.157738    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"]
Sep 10 14:56:13.171123 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:13.171081    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-9b1e67/premium-w0-9b1e67-kserve-d979df694-ct5k6"]
Sep 10 14:56:13.994886 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:13.994845    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c1d322-e38f-446a-a1a5-2d7c46361a70" path="/var/lib/kubelet/pods/a4c1d322-e38f-446a-a1a5-2d7c46361a70/volumes"
Sep 10 14:56:19.654104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:19.654061    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"]
Sep 10 14:56:19.654568 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:19.654247    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" containerID="cri-o://bd94d6e050dd114824d428f0f0aba8b79e07308111fec09f37ea4e31964865b2" gracePeriod=30
Sep 10 14:56:19.939661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:19.939565    2561 patch_prober.go:28] interesting pod/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:56:19.939661 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:19.939623    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:56:22.358736 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.358690    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"]
Sep 10 14:56:22.359210 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.359197    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c1d322-e38f-446a-a1a5-2d7c46361a70" containerName="main"
Sep 10 14:56:22.359251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.359212    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c1d322-e38f-446a-a1a5-2d7c46361a70" containerName="main"
Sep 10 14:56:22.359251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.359227    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95f51852-06a4-4600-aace-4b9c7aedb27f" containerName="revoke-keys"
Sep 10 14:56:22.359251 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.359233    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95f51852-06a4-4600-aace-4b9c7aedb27f" containerName="revoke-keys"
Sep 10 14:56:22.359366 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.359304    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c1d322-e38f-446a-a1a5-2d7c46361a70" containerName="main"
Sep 10 14:56:22.359366 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.359313    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95f51852-06a4-4600-aace-4b9c7aedb27f" containerName="revoke-keys"
Sep 10 14:56:22.363944 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.363918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"
Sep 10 14:56:22.368798 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.368760    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 14:56:22.386058 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.386026    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"]
Sep 10 14:56:22.452903 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.452859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02979a48-9bc8-4d39-b20a-1a9edafc24bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh\" (UID: \"02979a48-9bc8-4d39-b20a-1a9edafc24bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"
Sep 10 14:56:22.553659 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.553603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02979a48-9bc8-4d39-b20a-1a9edafc24bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh\" (UID: \"02979a48-9bc8-4d39-b20a-1a9edafc24bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"
Sep 10 14:56:22.554273 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.554250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02979a48-9bc8-4d39-b20a-1a9edafc24bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh\" (UID: \"02979a48-9bc8-4d39-b20a-1a9edafc24bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"
Sep 10 14:56:22.675740 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.675689    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"
Sep 10 14:56:22.966859 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:22.966831    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"]
Sep 10 14:56:22.969005 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:56:22.968958    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02979a48_9bc8_4d39_b20a_1a9edafc24bd.slice/crio-f645cbbf3347f31a87b51911ec9c0e61ed5453f52f4aebb87f47661dc01c7200 WatchSource:0}: Error finding container f645cbbf3347f31a87b51911ec9c0e61ed5453f52f4aebb87f47661dc01c7200: Status 404 returned error can't find the container with id f645cbbf3347f31a87b51911ec9c0e61ed5453f52f4aebb87f47661dc01c7200
Sep 10 14:56:23.874362 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:23.874329    2561 generic.go:356] "Generic (PLEG): container finished" podID="02979a48-9bc8-4d39-b20a-1a9edafc24bd" containerID="0a5fdfcbb89e66e5b53daa4564a08482e9ea9da81ab7158697bf78883e74c971" exitCode=0
Sep 10 14:56:23.874784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:23.874393    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh" event={"ID":"02979a48-9bc8-4d39-b20a-1a9edafc24bd","Type":"ContainerDied","Data":"0a5fdfcbb89e66e5b53daa4564a08482e9ea9da81ab7158697bf78883e74c971"}
Sep 10 14:56:23.874784 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:23.874456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh" event={"ID":"02979a48-9bc8-4d39-b20a-1a9edafc24bd","Type":"ContainerStarted","Data":"f645cbbf3347f31a87b51911ec9c0e61ed5453f52f4aebb87f47661dc01c7200"}
Sep 10 14:56:24.883723 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.883679    2561 generic.go:356] "Generic (PLEG): container finished" podID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerID="bd94d6e050dd114824d428f0f0aba8b79e07308111fec09f37ea4e31964865b2" exitCode=0
Sep 10 14:56:24.884139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.883738    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" event={"ID":"810d68f6-1cc8-45a2-9cd5-344b2e1636db","Type":"ContainerDied","Data":"bd94d6e050dd114824d428f0f0aba8b79e07308111fec09f37ea4e31964865b2"}
Sep 10 14:56:24.884139 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.883810    2561 scope.go:117] "RemoveContainer" containerID="7de6a1afe16d95cde62d5be03c363db25a3edad6a887754bb3fdceba18a9aea0"
Sep 10 14:56:24.926335 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.926266    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:56:24.982794 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.982762    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-podinfo\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.982989 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.982811    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-envoy\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.982989 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.982867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-certs\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.982989 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.982900    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvbjg\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-kube-api-access-bvbjg\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.982989 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.982923    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-credential-socket\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.982989 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.982963    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-token\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.983266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983002    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-socket\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.983266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983053    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istiod-ca-cert\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.983266 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983144    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-data\") pod \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\" (UID: \"810d68f6-1cc8-45a2-9cd5-344b2e1636db\") "
Sep 10 14:56:24.983424 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:24.983565 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983539    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-data" (OuterVolumeSpecName: "istio-data") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:24.983804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983765    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:24.983804 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983789    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:24.983943 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983843    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:24.983943 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.983870    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:56:24.984111 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.984084    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:24.986011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.985986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:24.986011 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.985997    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-kube-api-access-bvbjg" (OuterVolumeSpecName: "kube-api-access-bvbjg") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "kube-api-access-bvbjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:56:24.986197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.986039    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-token" (OuterVolumeSpecName: "istio-token") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:56:24.986197 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:24.986137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "810d68f6-1cc8-45a2-9cd5-344b2e1636db" (UID: "810d68f6-1cc8-45a2-9cd5-344b2e1636db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:56:25.027760 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.027734    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"
Sep 10 14:56:25.085153 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085121    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02979a48-9bc8-4d39-b20a-1a9edafc24bd-maas-api-service-ca\") pod \"02979a48-9bc8-4d39-b20a-1a9edafc24bd\" (UID: \"02979a48-9bc8-4d39-b20a-1a9edafc24bd\") "
Sep 10 14:56:25.085489 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085459    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02979a48-9bc8-4d39-b20a-1a9edafc24bd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "02979a48-9bc8-4d39-b20a-1a9edafc24bd" (UID: "02979a48-9bc8-4d39-b20a-1a9edafc24bd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:56:25.085599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085465    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.085599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085512    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.085599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085522    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvbjg\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-kube-api-access-bvbjg\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.085599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085533    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.085599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085544    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.085599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085558    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810d68f6-1cc8-45a2-9cd5-344b2e1636db-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.085599 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.085566    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810d68f6-1cc8-45a2-9cd5-344b2e1636db-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.187264 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.187174    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02979a48-9bc8-4d39-b20a-1a9edafc24bd-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:25.891318 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.891285    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"
Sep 10 14:56:25.891851 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.891285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh" event={"ID":"02979a48-9bc8-4d39-b20a-1a9edafc24bd","Type":"ContainerDied","Data":"f645cbbf3347f31a87b51911ec9c0e61ed5453f52f4aebb87f47661dc01c7200"}
Sep 10 14:56:25.891851 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.891448    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f645cbbf3347f31a87b51911ec9c0e61ed5453f52f4aebb87f47661dc01c7200"
Sep 10 14:56:25.893137 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.893107    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"
Sep 10 14:56:25.893285 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.893162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn" event={"ID":"810d68f6-1cc8-45a2-9cd5-344b2e1636db","Type":"ContainerDied","Data":"daa245839fa0545066ca72f79a4828466233cd6c324ceb9d3d537f85a8f9ddb6"}
Sep 10 14:56:25.893285 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.893210    2561 scope.go:117] "RemoveContainer" containerID="bd94d6e050dd114824d428f0f0aba8b79e07308111fec09f37ea4e31964865b2"
Sep 10 14:56:25.930892 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.930840    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"]
Sep 10 14:56:25.935908 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:25.935875    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-9b1e67-openshift-default-788b76c8d8-lwhvn"]
Sep 10 14:56:26.003474 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:26.003437    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" path="/var/lib/kubelet/pods/810d68f6-1cc8-45a2-9cd5-344b2e1636db/volumes"
Sep 10 14:56:27.203488 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:27.203450    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"]
Sep 10 14:56:27.276893 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:27.276854    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"]
Sep 10 14:56:38.440544 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:38.440433    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"]
Sep 10 14:56:38.461813 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:38.461779    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-5b0323-29817525-hm9gj"]
Sep 10 14:56:39.049980 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:39.049946    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"]
Sep 10 14:56:39.054921 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:39.054899    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-5b0323-vvfhh"]
Sep 10 14:56:39.993942 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:39.993911    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02979a48-9bc8-4d39-b20a-1a9edafc24bd" path="/var/lib/kubelet/pods/02979a48-9bc8-4d39-b20a-1a9edafc24bd/volumes"
Sep 10 14:56:39.994326 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:39.994239    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b05bb995-9c0f-4836-a91c-f2be105e0729" path="/var/lib/kubelet/pods/b05bb995-9c0f-4836-a91c-f2be105e0729/volumes"
Sep 10 14:56:42.224467 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.224401    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2" podUID="623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" containerName="main" containerID="cri-o://5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60" gracePeriod=45
Sep 10 14:56:42.297078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.297029    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv" podUID="5b35aea7-3aa6-475d-8c18-966a3a2c0d49" containerName="main" containerID="cri-o://3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945" gracePeriod=45
Sep 10 14:56:42.585315 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.585288    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:56:42.591918 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.591885    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:56:42.683404 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683365    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-home\") pod \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") "
Sep 10 14:56:42.683580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683438    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tmp-dir\") pod \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") "
Sep 10 14:56:42.683580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683517    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tls-certs\") pod \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") "
Sep 10 14:56:42.683580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683554    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-model-cache\") pod \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") "
Sep 10 14:56:42.683768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683582    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-dshm\") pod \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") "
Sep 10 14:56:42.683768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-home\") pod \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") "
Sep 10 14:56:42.683768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683636    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-model-cache\") pod \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") "
Sep 10 14:56:42.683768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683656    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-home" (OuterVolumeSpecName: "home") pod "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" (UID: "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.683768 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683730    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tls-certs\") pod \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") "
Sep 10 14:56:42.684009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683757    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" (UID: "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.684009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683793    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h8k9\" (UniqueName: \"kubernetes.io/projected/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-kube-api-access-9h8k9\") pod \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\" (UID: \"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0\") "
Sep 10 14:56:42.684009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683823    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b35aea7-3aa6-475d-8c18-966a3a2c0d49" (UID: "5b35aea7-3aa6-475d-8c18-966a3a2c0d49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.684009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683875    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-dshm\") pod \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") "
Sep 10 14:56:42.684009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683896    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-home" (OuterVolumeSpecName: "home") pod "5b35aea7-3aa6-475d-8c18-966a3a2c0d49" (UID: "5b35aea7-3aa6-475d-8c18-966a3a2c0d49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.684009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683933    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tmp-dir\") pod \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") "
Sep 10 14:56:42.684009 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.683978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8t42\" (UniqueName: \"kubernetes.io/projected/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-kube-api-access-p8t42\") pod \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\" (UID: \"5b35aea7-3aa6-475d-8c18-966a3a2c0d49\") "
Sep 10 14:56:42.684380 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.684106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" (UID: "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.685072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.684499    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.685072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.684524    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.685072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.684539    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.685072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.684553    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.685072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.684565    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.685072 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.685030    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b35aea7-3aa6-475d-8c18-966a3a2c0d49" (UID: "5b35aea7-3aa6-475d-8c18-966a3a2c0d49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.687172 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.687146    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" (UID: "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:56:42.687327 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.687299    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-kube-api-access-9h8k9" (OuterVolumeSpecName: "kube-api-access-9h8k9") pod "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" (UID: "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0"). InnerVolumeSpecName "kube-api-access-9h8k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:56:42.687677 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.687631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-kube-api-access-p8t42" (OuterVolumeSpecName: "kube-api-access-p8t42") pod "5b35aea7-3aa6-475d-8c18-966a3a2c0d49" (UID: "5b35aea7-3aa6-475d-8c18-966a3a2c0d49"). InnerVolumeSpecName "kube-api-access-p8t42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:56:42.688175 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.688143    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b35aea7-3aa6-475d-8c18-966a3a2c0d49" (UID: "5b35aea7-3aa6-475d-8c18-966a3a2c0d49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:56:42.688361 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.688335    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-dshm" (OuterVolumeSpecName: "dshm") pod "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" (UID: "623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.688838 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.688814    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-dshm" (OuterVolumeSpecName: "dshm") pod "5b35aea7-3aa6-475d-8c18-966a3a2c0d49" (UID: "5b35aea7-3aa6-475d-8c18-966a3a2c0d49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:42.785990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.785893    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.785990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.785928    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.785990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.785939    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h8k9\" (UniqueName: \"kubernetes.io/projected/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0-kube-api-access-9h8k9\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.785990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.785947    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.785990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.785957    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.785990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.785965    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8t42\" (UniqueName: \"kubernetes.io/projected/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-kube-api-access-p8t42\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:42.785990 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:42.785972    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b35aea7-3aa6-475d-8c18-966a3a2c0d49-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:43.006346 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.006306    2561 generic.go:356] "Generic (PLEG): container finished" podID="5b35aea7-3aa6-475d-8c18-966a3a2c0d49" containerID="3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945" exitCode=0
Sep 10 14:56:43.006546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.006352    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"
Sep 10 14:56:43.006546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.006390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv" event={"ID":"5b35aea7-3aa6-475d-8c18-966a3a2c0d49","Type":"ContainerDied","Data":"3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945"}
Sep 10 14:56:43.006546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.006432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv" event={"ID":"5b35aea7-3aa6-475d-8c18-966a3a2c0d49","Type":"ContainerDied","Data":"7b0c472d4dbb4d11a67348b16695c4e9ec8e3509f3a91456cee633693f2e3593"}
Sep 10 14:56:43.006546 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.006454    2561 scope.go:117] "RemoveContainer" containerID="3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945"
Sep 10 14:56:43.008257 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.008226    2561 generic.go:356] "Generic (PLEG): container finished" podID="623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" containerID="5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60" exitCode=0
Sep 10 14:56:43.008391 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.008258    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"
Sep 10 14:56:43.008391 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.008271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2" event={"ID":"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0","Type":"ContainerDied","Data":"5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60"}
Sep 10 14:56:43.008391 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.008295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2" event={"ID":"623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0","Type":"ContainerDied","Data":"1382c97f38f73ae2063a213047a3012a496fd084b8054057a986b02dc29f05b4"}
Sep 10 14:56:43.018333 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.018306    2561 scope.go:117] "RemoveContainer" containerID="3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945"
Sep 10 14:56:43.018713 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:56:43.018678    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945\": container with ID starting with 3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945 not found: ID does not exist" containerID="3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945"
Sep 10 14:56:43.018823 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.018730    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945"} err="failed to get container status \"3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945\": rpc error: code = NotFound desc = could not find container \"3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945\": container with ID starting with 3856db0ea32c6fe58487456364f1c71af516a4b78dc0bb2c01b47528d2957945 not found: ID does not exist"
Sep 10 14:56:43.018823 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.018754    2561 scope.go:117] "RemoveContainer" containerID="5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60"
Sep 10 14:56:43.028124 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.028104    2561 scope.go:117] "RemoveContainer" containerID="5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60"
Sep 10 14:56:43.028458 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:56:43.028438    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60\": container with ID starting with 5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60 not found: ID does not exist" containerID="5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60"
Sep 10 14:56:43.028505 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.028466    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60"} err="failed to get container status \"5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60\": rpc error: code = NotFound desc = could not find container \"5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60\": container with ID starting with 5e435ffd66dc1c05107a6636c7fc1f6c61498ed32c51eddf3594c146b86e5a60 not found: ID does not exist"
Sep 10 14:56:43.047955 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.047866    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"]
Sep 10 14:56:43.073066 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.073031    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/simulator-w4-5b0323-kserve-578fd7df8b-v4pfv"]
Sep 10 14:56:43.115346 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.115298    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"]
Sep 10 14:56:43.117899 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.117863    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5b0323/distinct-2-w4-5b0323-kserve-794d7b6457-rzzf2"]
Sep 10 14:56:43.995527 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.995485    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b35aea7-3aa6-475d-8c18-966a3a2c0d49" path="/var/lib/kubelet/pods/5b35aea7-3aa6-475d-8c18-966a3a2c0d49/volumes"
Sep 10 14:56:43.995964 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:43.995947    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" path="/var/lib/kubelet/pods/623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0/volumes"
Sep 10 14:56:50.555151 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:50.555109    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"]
Sep 10 14:56:50.555637 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:50.555402    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" containerID="cri-o://3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035" gracePeriod=30
Sep 10 14:56:51.002558 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:51.002522    2561 patch_prober.go:28] interesting pod/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:56:51.002754 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:51.002594    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:56:55.816253 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.816222    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:56:55.931078 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-podinfo\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931239 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-data\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931239 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931227    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxrq6\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-kube-api-access-xxrq6\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931341 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931252    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-certs\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931407    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-token\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931431 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931422    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-data" (OuterVolumeSpecName: "istio-data") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:55.931545 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931461    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-credential-socket\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931545 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istiod-ca-cert\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931545 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931532    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-socket\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931724 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931578    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-envoy\") pod \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\" (UID: \"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc\") "
Sep 10 14:56:55.931724 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931596    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:55.932001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931876    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:55.932001 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.931960    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:56:55.932222 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.932144    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:55.932284 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.932225    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:55.932284 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.932247    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:55.932284 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.932261    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:55.932284 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.932273    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:55.933769 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.933740    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-kube-api-access-xxrq6" (OuterVolumeSpecName: "kube-api-access-xxrq6") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "kube-api-access-xxrq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:56:55.933967 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.933849    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:56:55.934191 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.934166    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:56:55.934287 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:55.934203    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" (UID: "77ca73e8-b1fb-4f16-8379-b3eb02d61dfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:56:56.033372 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.033337    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxrq6\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-kube-api-access-xxrq6\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:56.033372 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.033375    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:56.033580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.033392    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:56.033580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.033407    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:56.033580 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.033422    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:56:56.096924 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.096888    2561 generic.go:356] "Generic (PLEG): container finished" podID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerID="3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035" exitCode=0
Sep 10 14:56:56.097103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.096946    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"
Sep 10 14:56:56.097103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.096968    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" event={"ID":"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc","Type":"ContainerDied","Data":"3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035"}
Sep 10 14:56:56.097103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.097016    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j" event={"ID":"77ca73e8-b1fb-4f16-8379-b3eb02d61dfc","Type":"ContainerDied","Data":"9c9836d59ff2ce839a7598e1a353104d55bb3c264d14e16aa94ce60662a85ec8"}
Sep 10 14:56:56.097103 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.097038    2561 scope.go:117] "RemoveContainer" containerID="3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035"
Sep 10 14:56:56.106629 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.106609    2561 scope.go:117] "RemoveContainer" containerID="e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209"
Sep 10 14:56:56.115732 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.115690    2561 scope.go:117] "RemoveContainer" containerID="3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035"
Sep 10 14:56:56.116062 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:56:56.116039    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035\": container with ID starting with 3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035 not found: ID does not exist" containerID="3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035"
Sep 10 14:56:56.116118 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.116072    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035"} err="failed to get container status \"3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035\": rpc error: code = NotFound desc = could not find container \"3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035\": container with ID starting with 3c608f9cd5e95bcc2d35031762d03cc4d119a81e660acf22261eed2a6880a035 not found: ID does not exist"
Sep 10 14:56:56.116118 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.116092    2561 scope.go:117] "RemoveContainer" containerID="e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209"
Sep 10 14:56:56.116394 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:56:56.116372    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209\": container with ID starting with e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209 not found: ID does not exist" containerID="e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209"
Sep 10 14:56:56.116445 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.116402    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209"} err="failed to get container status \"e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209\": rpc error: code = NotFound desc = could not find container \"e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209\": container with ID starting with e74def0ec8a043e34f40d4104f9cb2f64fd7fbb9bcf215ee9204266f4cfe1209 not found: ID does not exist"
Sep 10 14:56:56.133022 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.132985    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"]
Sep 10 14:56:56.135231 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:56.135205    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-5b0323-openshift-default-697988d4fd-77d6j"]
Sep 10 14:56:57.994657 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:56:57.994620    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" path="/var/lib/kubelet/pods/77ca73e8-b1fb-4f16-8379-b3eb02d61dfc/volumes"
Sep 10 14:57:03.232536 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:03.232498    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"]
Sep 10 14:57:06.912127 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:06.912089    2561 scope.go:117] "RemoveContainer" containerID="66f20b32528123085397f35a23fa0a6577b1c0de391880a5ebfa9e11ca47d628"
Sep 10 14:57:06.921330 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:06.921306    2561 scope.go:117] "RemoveContainer" containerID="0d2b6a800468e7473742a4fbb715c1217d38bfff2407d3014bb3fbbb5af0c62c"
Sep 10 14:57:18.252620 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.252569    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2" podUID="febe2d6e-b80d-4298-8ff6-eb5dda646209" containerName="main" containerID="cri-o://f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2" gracePeriod=45
Sep 10 14:57:18.519877 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.519851    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:57:18.675550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675514    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/febe2d6e-b80d-4298-8ff6-eb5dda646209-tls-certs\") pod \"febe2d6e-b80d-4298-8ff6-eb5dda646209\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") "
Sep 10 14:57:18.675550 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675561    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-model-cache\") pod \"febe2d6e-b80d-4298-8ff6-eb5dda646209\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") "
Sep 10 14:57:18.675827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675607    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tphhs\" (UniqueName: \"kubernetes.io/projected/febe2d6e-b80d-4298-8ff6-eb5dda646209-kube-api-access-tphhs\") pod \"febe2d6e-b80d-4298-8ff6-eb5dda646209\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") "
Sep 10 14:57:18.675827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675633    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-tmp-dir\") pod \"febe2d6e-b80d-4298-8ff6-eb5dda646209\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") "
Sep 10 14:57:18.675827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675665    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-dshm\") pod \"febe2d6e-b80d-4298-8ff6-eb5dda646209\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") "
Sep 10 14:57:18.675827 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675694    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-home\") pod \"febe2d6e-b80d-4298-8ff6-eb5dda646209\" (UID: \"febe2d6e-b80d-4298-8ff6-eb5dda646209\") "
Sep 10 14:57:18.676047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675981    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "febe2d6e-b80d-4298-8ff6-eb5dda646209" (UID: "febe2d6e-b80d-4298-8ff6-eb5dda646209"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:57:18.676047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675990    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-model-cache" (OuterVolumeSpecName: "model-cache") pod "febe2d6e-b80d-4298-8ff6-eb5dda646209" (UID: "febe2d6e-b80d-4298-8ff6-eb5dda646209"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:57:18.676047 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.675999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-home" (OuterVolumeSpecName: "home") pod "febe2d6e-b80d-4298-8ff6-eb5dda646209" (UID: "febe2d6e-b80d-4298-8ff6-eb5dda646209"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:57:18.676213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.676159    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:57:18.676213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.676173    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:57:18.676213 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.676182    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:57:18.677941 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.677914    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-dshm" (OuterVolumeSpecName: "dshm") pod "febe2d6e-b80d-4298-8ff6-eb5dda646209" (UID: "febe2d6e-b80d-4298-8ff6-eb5dda646209"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:57:18.678319 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.678302    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febe2d6e-b80d-4298-8ff6-eb5dda646209-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "febe2d6e-b80d-4298-8ff6-eb5dda646209" (UID: "febe2d6e-b80d-4298-8ff6-eb5dda646209"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:57:18.678373 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.678328    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febe2d6e-b80d-4298-8ff6-eb5dda646209-kube-api-access-tphhs" (OuterVolumeSpecName: "kube-api-access-tphhs") pod "febe2d6e-b80d-4298-8ff6-eb5dda646209" (UID: "febe2d6e-b80d-4298-8ff6-eb5dda646209"). InnerVolumeSpecName "kube-api-access-tphhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:57:18.776876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.776793    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/febe2d6e-b80d-4298-8ff6-eb5dda646209-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:57:18.776876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.776823    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tphhs\" (UniqueName: \"kubernetes.io/projected/febe2d6e-b80d-4298-8ff6-eb5dda646209-kube-api-access-tphhs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:57:18.776876 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:18.776834    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/febe2d6e-b80d-4298-8ff6-eb5dda646209-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:57:19.254648 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.254609    2561 generic.go:356] "Generic (PLEG): container finished" podID="febe2d6e-b80d-4298-8ff6-eb5dda646209" containerID="f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2" exitCode=0
Sep 10 14:57:19.255104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.254652    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"
Sep 10 14:57:19.255104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.254716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2" event={"ID":"febe2d6e-b80d-4298-8ff6-eb5dda646209","Type":"ContainerDied","Data":"f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2"}
Sep 10 14:57:19.255104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.254769    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2" event={"ID":"febe2d6e-b80d-4298-8ff6-eb5dda646209","Type":"ContainerDied","Data":"f404bf7f30634cac9c0e1f3146bbefda0ab336c28c6e17d2181d84b10a961cd9"}
Sep 10 14:57:19.255104 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.254789    2561 scope.go:117] "RemoveContainer" containerID="f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2"
Sep 10 14:57:19.264887 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.264868    2561 scope.go:117] "RemoveContainer" containerID="f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2"
Sep 10 14:57:19.265190 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:57:19.265174    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2\": container with ID starting with f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2 not found: ID does not exist" containerID="f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2"
Sep 10 14:57:19.265227 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.265200    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2"} err="failed to get container status \"f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2\": rpc error: code = NotFound desc = could not find container \"f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2\": container with ID starting with f076400e101705840d77bd50b3d73f6fdd0aa2118efb44c485128ece3f7fcce2 not found: ID does not exist"
Sep 10 14:57:19.292691 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.292655    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"]
Sep 10 14:57:19.298531 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.298502    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/auth-test-model-e6941c-kserve-c9457867-h9xz2"]
Sep 10 14:57:19.994204 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:19.994167    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="febe2d6e-b80d-4298-8ff6-eb5dda646209" path="/var/lib/kubelet/pods/febe2d6e-b80d-4298-8ff6-eb5dda646209/volumes"
Sep 10 14:57:58.602102 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602002    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"]
Sep 10 14:57:58.602774 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602752    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febe2d6e-b80d-4298-8ff6-eb5dda646209" containerName="main"
Sep 10 14:57:58.602774 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602775    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="febe2d6e-b80d-4298-8ff6-eb5dda646209" containerName="main"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602795    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602804    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602817    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602825    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602841    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b35aea7-3aa6-475d-8c18-966a3a2c0d49" containerName="main"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602849    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b35aea7-3aa6-475d-8c18-966a3a2c0d49" containerName="main"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602859    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602867    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602902    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" containerName="main"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602911    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" containerName="main"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602926    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02979a48-9bc8-4d39-b20a-1a9edafc24bd" containerName="revoke-keys"
Sep 10 14:57:58.602936 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.602935    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02979a48-9bc8-4d39-b20a-1a9edafc24bd" containerName="revoke-keys"
Sep 10 14:57:58.603499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.603061    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy"
Sep 10 14:57:58.603499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.603077    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b35aea7-3aa6-475d-8c18-966a3a2c0d49" containerName="main"
Sep 10 14:57:58.603499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.603086    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="febe2d6e-b80d-4298-8ff6-eb5dda646209" containerName="main"
Sep 10 14:57:58.603499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.603096    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy"
Sep 10 14:57:58.603499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.603105    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="623af7eb-cd43-4fc2-8b09-e2b9bbecb1c0" containerName="main"
Sep 10 14:57:58.603499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.603116    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02979a48-9bc8-4d39-b20a-1a9edafc24bd" containerName="revoke-keys"
Sep 10 14:57:58.603499 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.603126    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="810d68f6-1cc8-45a2-9cd5-344b2e1636db" containerName="istio-proxy"
Sep 10 14:57:58.606728 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.606683    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.610547 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.610514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-model-cache\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.610692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.610576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629b25b3-20a2-438a-ac3a-c22890d144eb-tls-certs\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.610692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.610637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-home\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.610692 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.610683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-dshm\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.610901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.610725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-tmp-dir\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.610901 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.610842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pl6c\" (UniqueName: \"kubernetes.io/projected/629b25b3-20a2-438a-ac3a-c22890d144eb-kube-api-access-6pl6c\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.612099 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.612078    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"openshift-service-ca.crt\""
Sep 10 14:57:58.613603 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.613465    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"default-dockercfg-xkqhb\""
Sep 10 14:57:58.613603 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.613505    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"kube-root-ca.crt\""
Sep 10 14:57:58.613603 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.613518    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6941c\"/\"sub-test-model-e6941c-kserve-self-signed-certs\""
Sep 10 14:57:58.630435 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.630399    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"]
Sep 10 14:57:58.711332 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629b25b3-20a2-438a-ac3a-c22890d144eb-tls-certs\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711332 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-home\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-dshm\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-tmp-dir\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pl6c\" (UniqueName: \"kubernetes.io/projected/629b25b3-20a2-438a-ac3a-c22890d144eb-kube-api-access-6pl6c\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711601 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-model-cache\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711871 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-tmp-dir\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711871 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-home\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.711957 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.711892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-model-cache\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.713815 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.713784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-dshm\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.713992 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.713973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629b25b3-20a2-438a-ac3a-c22890d144eb-tls-certs\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.728400 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.728365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pl6c\" (UniqueName: \"kubernetes.io/projected/629b25b3-20a2-438a-ac3a-c22890d144eb-kube-api-access-6pl6c\") pod \"sub-test-model-e6941c-kserve-5659457b59-sp4hm\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") " pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:58.917510 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:58.917463    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:57:59.221432 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:59.221401    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"]
Sep 10 14:57:59.224464 ip-10-0-137-62 kubenswrapper[2561]: W0910 14:57:59.224431    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod629b25b3_20a2_438a_ac3a_c22890d144eb.slice/crio-5c4475bc8c1e4a1bf89750de18e8fea97b97e7d8514a23f87e3e7a3f499ad121 WatchSource:0}: Error finding container 5c4475bc8c1e4a1bf89750de18e8fea97b97e7d8514a23f87e3e7a3f499ad121: Status 404 returned error can't find the container with id 5c4475bc8c1e4a1bf89750de18e8fea97b97e7d8514a23f87e3e7a3f499ad121
Sep 10 14:57:59.491824 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:59.491694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm" event={"ID":"629b25b3-20a2-438a-ac3a-c22890d144eb","Type":"ContainerStarted","Data":"c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332"}
Sep 10 14:57:59.491824 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:59.491778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm" event={"ID":"629b25b3-20a2-438a-ac3a-c22890d144eb","Type":"ContainerStarted","Data":"5c4475bc8c1e4a1bf89750de18e8fea97b97e7d8514a23f87e3e7a3f499ad121"}
Sep 10 14:57:59.523203 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:57:59.523150    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm" podStartSLOduration=1.523134679 podStartE2EDuration="1.523134679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:57:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:57:59.52140318 +0000 UTC m=+1793.985769702" watchObservedRunningTime="2026-09-10 14:57:59.523134679 +0000 UTC m=+1793.987501201"
Sep 10 14:58:08.917696 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:08.917653    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:58:08.918195 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:08.917735    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:58:08.935325 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:08.935290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:58:09.560756 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:09.560725    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:58:40.488516 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:40.488473    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"]
Sep 10 14:58:55.508458 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.508396    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm" podUID="629b25b3-20a2-438a-ac3a-c22890d144eb" containerName="main" containerID="cri-o://c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332" gracePeriod=45
Sep 10 14:58:55.767002 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.766933    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:58:55.821796 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.821755    2561 generic.go:356] "Generic (PLEG): container finished" podID="629b25b3-20a2-438a-ac3a-c22890d144eb" containerID="c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332" exitCode=0
Sep 10 14:58:55.821978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.821807    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"
Sep 10 14:58:55.821978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.821832    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm" event={"ID":"629b25b3-20a2-438a-ac3a-c22890d144eb","Type":"ContainerDied","Data":"c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332"}
Sep 10 14:58:55.821978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.821881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm" event={"ID":"629b25b3-20a2-438a-ac3a-c22890d144eb","Type":"ContainerDied","Data":"5c4475bc8c1e4a1bf89750de18e8fea97b97e7d8514a23f87e3e7a3f499ad121"}
Sep 10 14:58:55.821978 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.821898    2561 scope.go:117] "RemoveContainer" containerID="c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332"
Sep 10 14:58:55.831156 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.831130    2561 scope.go:117] "RemoveContainer" containerID="c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332"
Sep 10 14:58:55.831460 ip-10-0-137-62 kubenswrapper[2561]: E0910 14:58:55.831437    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332\": container with ID starting with c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332 not found: ID does not exist" containerID="c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332"
Sep 10 14:58:55.831537 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.831471    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332"} err="failed to get container status \"c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332\": rpc error: code = NotFound desc = could not find container \"c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332\": container with ID starting with c4f83d2ffbc34129243b26ae61a0318b2ba246479afa6c3948faf9fbd8b6a332 not found: ID does not exist"
Sep 10 14:58:55.932231 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pl6c\" (UniqueName: \"kubernetes.io/projected/629b25b3-20a2-438a-ac3a-c22890d144eb-kube-api-access-6pl6c\") pod \"629b25b3-20a2-438a-ac3a-c22890d144eb\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") "
Sep 10 14:58:55.932428 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932260    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629b25b3-20a2-438a-ac3a-c22890d144eb-tls-certs\") pod \"629b25b3-20a2-438a-ac3a-c22890d144eb\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") "
Sep 10 14:58:55.932428 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932305    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-dshm\") pod \"629b25b3-20a2-438a-ac3a-c22890d144eb\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") "
Sep 10 14:58:55.932428 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932378    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-tmp-dir\") pod \"629b25b3-20a2-438a-ac3a-c22890d144eb\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") "
Sep 10 14:58:55.932428 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932414    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-model-cache\") pod \"629b25b3-20a2-438a-ac3a-c22890d144eb\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") "
Sep 10 14:58:55.932767 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932440    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-home\") pod \"629b25b3-20a2-438a-ac3a-c22890d144eb\" (UID: \"629b25b3-20a2-438a-ac3a-c22890d144eb\") "
Sep 10 14:58:55.932829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932759    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "629b25b3-20a2-438a-ac3a-c22890d144eb" (UID: "629b25b3-20a2-438a-ac3a-c22890d144eb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:58:55.932829 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932769    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-model-cache" (OuterVolumeSpecName: "model-cache") pod "629b25b3-20a2-438a-ac3a-c22890d144eb" (UID: "629b25b3-20a2-438a-ac3a-c22890d144eb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:58:55.932981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.932949    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-home" (OuterVolumeSpecName: "home") pod "629b25b3-20a2-438a-ac3a-c22890d144eb" (UID: "629b25b3-20a2-438a-ac3a-c22890d144eb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:58:55.933114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.933021    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:58:55.933114 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.933043    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:58:55.934551 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.934522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-dshm" (OuterVolumeSpecName: "dshm") pod "629b25b3-20a2-438a-ac3a-c22890d144eb" (UID: "629b25b3-20a2-438a-ac3a-c22890d144eb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:58:55.934687 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.934617    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/629b25b3-20a2-438a-ac3a-c22890d144eb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "629b25b3-20a2-438a-ac3a-c22890d144eb" (UID: "629b25b3-20a2-438a-ac3a-c22890d144eb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:58:55.934788 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:55.934694    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/629b25b3-20a2-438a-ac3a-c22890d144eb-kube-api-access-6pl6c" (OuterVolumeSpecName: "kube-api-access-6pl6c") pod "629b25b3-20a2-438a-ac3a-c22890d144eb" (UID: "629b25b3-20a2-438a-ac3a-c22890d144eb"). InnerVolumeSpecName "kube-api-access-6pl6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:58:56.034386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:56.034288    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pl6c\" (UniqueName: \"kubernetes.io/projected/629b25b3-20a2-438a-ac3a-c22890d144eb-kube-api-access-6pl6c\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:58:56.034386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:56.034322    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/629b25b3-20a2-438a-ac3a-c22890d144eb-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:58:56.034386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:56.034334    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:58:56.034386 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:56.034342    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/629b25b3-20a2-438a-ac3a-c22890d144eb-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 14:58:56.154981 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:56.154941    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"]
Sep 10 14:58:56.180534 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:56.180498    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6941c/sub-test-model-e6941c-kserve-5659457b59-sp4hm"]
Sep 10 14:58:57.994090 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:58:57.994054    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="629b25b3-20a2-438a-ac3a-c22890d144eb" path="/var/lib/kubelet/pods/629b25b3-20a2-438a-ac3a-c22890d144eb/volumes"
Sep 10 14:59:06.984034 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:59:06.983995    2561 scope.go:117] "RemoveContainer" containerID="4915950b71e8ad916ebc024065f9dcf2790abf3ddc390a2eda405ee7badf7fab"
Sep 10 14:59:06.992963 ip-10-0-137-62 kubenswrapper[2561]: I0910 14:59:06.992942    2561 scope.go:117] "RemoveContainer" containerID="38bde01a3395b4d5606a4b49aeaae8188ad73d5421479a3c2e367cdb45b01150"
Sep 10 15:00:00.144540 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.144491    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"]
Sep 10 15:00:00.145735 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.145691    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy"
Sep 10 15:00:00.145735 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.145734    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy"
Sep 10 15:00:00.145963 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.145789    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629b25b3-20a2-438a-ac3a-c22890d144eb" containerName="main"
Sep 10 15:00:00.145963 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.145800    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="629b25b3-20a2-438a-ac3a-c22890d144eb" containerName="main"
Sep 10 15:00:00.146059 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.146025    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="77ca73e8-b1fb-4f16-8379-b3eb02d61dfc" containerName="istio-proxy"
Sep 10 15:00:00.146059 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.146050    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="629b25b3-20a2-438a-ac3a-c22890d144eb" containerName="main"
Sep 10 15:00:00.152080 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.152046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"
Sep 10 15:00:00.155039 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.155012    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj"]
Sep 10 15:00:00.155182 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.155162    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 15:00:00.158879 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.158857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj"
Sep 10 15:00:00.164410 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.164389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"
Sep 10 15:00:00.170671 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.170630    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"]
Sep 10 15:00:00.174447 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.174425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj"
Sep 10 15:00:00.197832 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.194034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj"]
Sep 10 15:00:00.469073 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.469041    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"]
Sep 10 15:00:00.470639 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:00:00.470593    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda388f912_7e3b_4470_a202_993fff585d86.slice/crio-c38a9e69012e1b978f94fe5d51887ceaf1466e0c66be151cdde61ae5615360c6 WatchSource:0}: Error finding container c38a9e69012e1b978f94fe5d51887ceaf1466e0c66be151cdde61ae5615360c6: Status 404 returned error can't find the container with id c38a9e69012e1b978f94fe5d51887ceaf1466e0c66be151cdde61ae5615360c6
Sep 10 15:00:00.478896 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:00:00.478866    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb819ab_6fc7_4d14_b3b5_3906433d9eac.slice/crio-d1bb00da493d99aed0775ac9b688f4e9877346af9c25a7da51e54b870f4c3c3f WatchSource:0}: Error finding container d1bb00da493d99aed0775ac9b688f4e9877346af9c25a7da51e54b870f4c3c3f: Status 404 returned error can't find the container with id d1bb00da493d99aed0775ac9b688f4e9877346af9c25a7da51e54b870f4c3c3f
Sep 10 15:00:00.480743 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:00.480721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj"]
Sep 10 15:00:01.205026 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:01.204991    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl" event={"ID":"a388f912-7e3b-4470-a202-993fff585d86","Type":"ContainerStarted","Data":"b0eafe610120c2f3d962931fd4ce0878990e496f5b2643427c81f615b588303d"}
Sep 10 15:00:01.205491 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:01.205050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl" event={"ID":"a388f912-7e3b-4470-a202-993fff585d86","Type":"ContainerStarted","Data":"c38a9e69012e1b978f94fe5d51887ceaf1466e0c66be151cdde61ae5615360c6"}
Sep 10 15:00:01.206525 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:01.206502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj" event={"ID":"2cb819ab-6fc7-4d14-b3b5-3906433d9eac","Type":"ContainerStarted","Data":"9be69240feb40b7b6854ad08863e506e4085b402439e08221cd65f08c54243d5"}
Sep 10 15:00:01.206644 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:01.206550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj" event={"ID":"2cb819ab-6fc7-4d14-b3b5-3906433d9eac","Type":"ContainerStarted","Data":"d1bb00da493d99aed0775ac9b688f4e9877346af9c25a7da51e54b870f4c3c3f"}
Sep 10 15:00:01.223006 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:01.222957    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl" podStartSLOduration=1.2229417009999999 podStartE2EDuration="1.222941701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:00:01.220772985 +0000 UTC m=+1915.685139504" watchObservedRunningTime="2026-09-10 15:00:01.222941701 +0000 UTC m=+1915.687308223"
Sep 10 15:00:01.239174 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:01.239119    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj" podStartSLOduration=1.239098926 podStartE2EDuration="1.239098926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:00:01.237441701 +0000 UTC m=+1915.701808223" watchObservedRunningTime="2026-09-10 15:00:01.239098926 +0000 UTC m=+1915.703465448"
Sep 10 15:00:02.213758 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:02.213718    2561 generic.go:356] "Generic (PLEG): container finished" podID="2cb819ab-6fc7-4d14-b3b5-3906433d9eac" containerID="9be69240feb40b7b6854ad08863e506e4085b402439e08221cd65f08c54243d5" exitCode=0
Sep 10 15:00:02.214218 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:02.213811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj" event={"ID":"2cb819ab-6fc7-4d14-b3b5-3906433d9eac","Type":"ContainerDied","Data":"9be69240feb40b7b6854ad08863e506e4085b402439e08221cd65f08c54243d5"}
Sep 10 15:00:02.215521 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:02.215497    2561 generic.go:356] "Generic (PLEG): container finished" podID="a388f912-7e3b-4470-a202-993fff585d86" containerID="b0eafe610120c2f3d962931fd4ce0878990e496f5b2643427c81f615b588303d" exitCode=0
Sep 10 15:00:02.215644 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:02.215584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl" event={"ID":"a388f912-7e3b-4470-a202-993fff585d86","Type":"ContainerDied","Data":"b0eafe610120c2f3d962931fd4ce0878990e496f5b2643427c81f615b588303d"}
Sep 10 15:00:03.382453 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:03.382424    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj"
Sep 10 15:00:03.384665 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:03.384644    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"
Sep 10 15:00:04.227901 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:04.227862    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"
Sep 10 15:00:04.228118 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:04.227898    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl" event={"ID":"a388f912-7e3b-4470-a202-993fff585d86","Type":"ContainerDied","Data":"c38a9e69012e1b978f94fe5d51887ceaf1466e0c66be151cdde61ae5615360c6"}
Sep 10 15:00:04.228118 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:04.227958    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c38a9e69012e1b978f94fe5d51887ceaf1466e0c66be151cdde61ae5615360c6"
Sep 10 15:00:04.229469 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:04.229451    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj"
Sep 10 15:00:04.229595 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:04.229449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-4qqqj" event={"ID":"2cb819ab-6fc7-4d14-b3b5-3906433d9eac","Type":"ContainerDied","Data":"d1bb00da493d99aed0775ac9b688f4e9877346af9c25a7da51e54b870f4c3c3f"}
Sep 10 15:00:04.229595 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:04.229539    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1bb00da493d99aed0775ac9b688f4e9877346af9c25a7da51e54b870f4c3c3f"
Sep 10 15:00:07.031012 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:07.030973    2561 scope.go:117] "RemoveContainer" containerID="2dd4abfad35ad442e93d51b1faeab98e2dca833c79e0be165826a75cdba41338"
Sep 10 15:00:07.041320 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:07.041296    2561 scope.go:117] "RemoveContainer" containerID="ef4b6888f75c162c38f86da3ac463c4b09a379f44d968878389b6b40f08cc08f"
Sep 10 15:00:12.153278 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.153246    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"]
Sep 10 15:00:12.153737 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.153721    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a388f912-7e3b-4470-a202-993fff585d86" containerName="cleanup"
Sep 10 15:00:12.153806 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.153740    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a388f912-7e3b-4470-a202-993fff585d86" containerName="cleanup"
Sep 10 15:00:12.153806 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.153750    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb819ab-6fc7-4d14-b3b5-3906433d9eac" containerName="cleanup"
Sep 10 15:00:12.153806 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.153756    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb819ab-6fc7-4d14-b3b5-3906433d9eac" containerName="cleanup"
Sep 10 15:00:12.153913 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.153835    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a388f912-7e3b-4470-a202-993fff585d86" containerName="cleanup"
Sep 10 15:00:12.153913 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.153845    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb819ab-6fc7-4d14-b3b5-3906433d9eac" containerName="cleanup"
Sep 10 15:00:12.157052 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.157036    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.162690 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:00:12.162652    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-ipp-a-ae0f24-openshift-default-dockercfg-7ksng\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ae0f24-openshift-default-dockercfg-7ksng\"" type="*v1.Secret"
Sep 10 15:00:12.164189 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:00:12.164153    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.191201 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.191170    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"]
Sep 10 15:00:12.228516 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-socket\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.228516 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228520    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-data\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.228804 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-token\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.228804 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-podinfo\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.228804 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istiod-ca-cert\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.228980 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcdn\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-kube-api-access-9pcdn\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.228980 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-credential-socket\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.229093 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.228990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-envoy\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.229093 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.229037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-certs\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330300 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcdn\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-kube-api-access-9pcdn\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330300 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-credential-socket\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330574 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-envoy\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330574 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-certs\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330574 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-socket\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330574 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-data\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330856 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-token\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330856 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-podinfo\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330856 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istiod-ca-cert\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.330856 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-certs\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.331021 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.330979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-credential-socket\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.331021 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.331005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-socket\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.331133 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.331110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-data\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.331553 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.331530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istiod-ca-cert\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.332935 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.332911    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-envoy\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.333315 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.333293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-podinfo\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.355553 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.355527    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcdn\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-kube-api-access-9pcdn\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:12.356063 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:12.356043    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-token\") pod \"e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") " pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:13.468804 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:13.468761    2561 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Sep 10 15:00:13.469277 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:13.468860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:13.649448 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:13.649404    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ae0f24-openshift-default-dockercfg-7ksng\""
Sep 10 15:00:13.759231 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:13.759198    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"]
Sep 10 15:00:13.760574 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:00:13.760546    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6df0c4_f9d4_4d13_9f03_66f46139e361.slice/crio-7cea254d372e7b422c152aed8b9d39728cdcbd9723edbfe6da4a761a58bcb866 WatchSource:0}: Error finding container 7cea254d372e7b422c152aed8b9d39728cdcbd9723edbfe6da4a761a58bcb866: Status 404 returned error can't find the container with id 7cea254d372e7b422c152aed8b9d39728cdcbd9723edbfe6da4a761a58bcb866
Sep 10 15:00:13.763567 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:13.763521    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:13.763663 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:13.763618    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:13.763716 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:13.763663    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:14.289103 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:14.289060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" event={"ID":"bc6df0c4-f9d4-4d13-9f03-66f46139e361","Type":"ContainerStarted","Data":"80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a"}
Sep 10 15:00:14.289301 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:14.289154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" event={"ID":"bc6df0c4-f9d4-4d13-9f03-66f46139e361","Type":"ContainerStarted","Data":"7cea254d372e7b422c152aed8b9d39728cdcbd9723edbfe6da4a761a58bcb866"}
Sep 10 15:00:14.469205 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:14.469169    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:14.474780 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:14.474755    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:14.508278 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:14.508223    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podStartSLOduration=2.508205171 podStartE2EDuration="2.508205171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:00:14.319323961 +0000 UTC m=+1928.783690483" watchObservedRunningTime="2026-09-10 15:00:14.508205171 +0000 UTC m=+1928.972571753"
Sep 10 15:00:15.298275 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:15.298230    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:15.299548 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:15.299491    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:31.339875 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:31.339834    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:00:31.340510 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:31.339889    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:00:32.409065 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:32.409030    2561 generic.go:356] "Generic (PLEG): container finished" podID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerID="80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a" exitCode=0
Sep 10 15:00:32.409487 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:32.409095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" event={"ID":"bc6df0c4-f9d4-4d13-9f03-66f46139e361","Type":"ContainerDied","Data":"80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a"}
Sep 10 15:00:32.409570 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:32.409553    2561 scope.go:117] "RemoveContainer" containerID="80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a"
Sep 10 15:00:32.410891 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:32.410858    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:32.410963 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:32.410928    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:32.410963 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:32.410958    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:33.416461 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:33.416427    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" event={"ID":"bc6df0c4-f9d4-4d13-9f03-66f46139e361","Type":"ContainerStarted","Data":"07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d"}
Sep 10 15:00:33.469601 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:33.469563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:33.469912 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:33.469885    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Sep 10 15:00:33.470004 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:33.469980    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Sep 10 15:00:34.469576 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:34.469539    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Sep 10 15:00:34.470083 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:34.469609    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Sep 10 15:00:35.469958 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:35.469920    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Sep 10 15:00:35.470357 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:35.469979    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Sep 10 15:00:36.470289 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:36.470247    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Sep 10 15:00:36.470828 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:36.470343    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Sep 10 15:00:37.469697 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:37.469660    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Sep 10 15:00:37.469890 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:37.469761    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Sep 10 15:00:38.473990 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:38.473959    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:38.474429 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:38.474407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:38.475214 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:38.475189    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:00:47.639984 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.639945    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"]
Sep 10 15:00:47.642771 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.642747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.646521 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.646497    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b8f4d6-openshift-default-dockercfg-9gsdl\""
Sep 10 15:00:47.670836 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.670800    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"]
Sep 10 15:00:47.703539 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-socket\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.703785 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-credential-socket\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.703785 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703612    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-certs\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.703785 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703635    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-istio-token\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.703785 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-data\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.703785 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-envoy\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.704080 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812c077d-be48-4d3b-aa31-e10dda927a44-istiod-ca-cert\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.704080 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfjz9\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-kube-api-access-cfjz9\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.704080 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.703950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812c077d-be48-4d3b-aa31-e10dda927a44-istio-podinfo\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805457 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-certs\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805457 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-istio-token\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805693 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-data\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805693 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-envoy\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805693 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812c077d-be48-4d3b-aa31-e10dda927a44-istiod-ca-cert\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805693 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfjz9\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-kube-api-access-cfjz9\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805966 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812c077d-be48-4d3b-aa31-e10dda927a44-istio-podinfo\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805966 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-socket\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.805966 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-credential-socket\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.806176 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.805991    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-certs\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.806176 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.806003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-data\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.806176 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.806158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-credential-socket\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.806336 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.806257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-socket\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.806431 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.806410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812c077d-be48-4d3b-aa31-e10dda927a44-istiod-ca-cert\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.808044 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.808017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-envoy\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.808228 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.808209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812c077d-be48-4d3b-aa31-e10dda927a44-istio-podinfo\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.817143 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.817114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-istio-token\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.818114 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.818090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfjz9\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-kube-api-access-cfjz9\") pod \"e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") " pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:47.953743 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:47.953667    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:48.247805 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.247779    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"]
Sep 10 15:00:48.249457 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:00:48.249435    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812c077d_be48_4d3b_aa31_e10dda927a44.slice/crio-b895968ed641e9a8e98427761b124340d22aba0690636760909c34bebf9d7ada WatchSource:0}: Error finding container b895968ed641e9a8e98427761b124340d22aba0690636760909c34bebf9d7ada: Status 404 returned error can't find the container with id b895968ed641e9a8e98427761b124340d22aba0690636760909c34bebf9d7ada
Sep 10 15:00:48.251869 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.251834    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:48.251941 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.251902    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:48.251941 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.251932    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:00:48.528234 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.528138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" event={"ID":"812c077d-be48-4d3b-aa31-e10dda927a44","Type":"ContainerStarted","Data":"6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63"}
Sep 10 15:00:48.528234 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.528214    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" event={"ID":"812c077d-be48-4d3b-aa31-e10dda927a44","Type":"ContainerStarted","Data":"b895968ed641e9a8e98427761b124340d22aba0690636760909c34bebf9d7ada"}
Sep 10 15:00:48.556157 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.556100    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podStartSLOduration=1.556083622 podStartE2EDuration="1.556083622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:00:48.552821796 +0000 UTC m=+1963.017188318" watchObservedRunningTime="2026-09-10 15:00:48.556083622 +0000 UTC m=+1963.020450144"
Sep 10 15:00:48.953832 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:48.953790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:49.960117 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:49.960079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:50.541038 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:50.541007    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:00:50.541906 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:00:50.541886    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:01:06.583921 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:06.583881    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:01:06.584421 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:06.583956    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:01:07.660477 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:07.660446    2561 generic.go:356] "Generic (PLEG): container finished" podID="812c077d-be48-4d3b-aa31-e10dda927a44" containerID="6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63" exitCode=0
Sep 10 15:01:07.660883 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:07.660518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" event={"ID":"812c077d-be48-4d3b-aa31-e10dda927a44","Type":"ContainerDied","Data":"6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63"}
Sep 10 15:01:07.661024 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:07.661009    2561 scope.go:117] "RemoveContainer" containerID="6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63"
Sep 10 15:01:07.662296 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:07.662267    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:01:07.662351 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:07.662341    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:01:07.662391 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:07.662375    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:01:08.668767 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:08.668729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" event={"ID":"812c077d-be48-4d3b-aa31-e10dda927a44","Type":"ContainerStarted","Data":"4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d"}
Sep 10 15:01:08.953942 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:08.953849    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:01:08.954127 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:08.954100    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Sep 10 15:01:08.954172 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:08.954154    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Sep 10 15:01:09.954674 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:09.954630    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Sep 10 15:01:09.955117 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:09.954735    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Sep 10 15:01:10.954364 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:10.954321    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Sep 10 15:01:10.954571 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:10.954386    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Sep 10 15:01:11.954425 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:11.954382    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Sep 10 15:01:11.954837 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:11.954448    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Sep 10 15:01:12.954986 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:12.954940    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused" start-of-body=
Sep 10 15:01:12.955372 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:12.955006    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.105:15021/healthz/ready\": dial tcp 10.134.0.105:15021: connect: connection refused"
Sep 10 15:01:13.957956 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:13.957920    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:01:13.958306 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:13.958187    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:01:13.959020 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:01:13.958999    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:02:07.077227 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.077193    2561 scope.go:117] "RemoveContainer" containerID="7ca6a6623700b9408960f75e6dbf250828862ee03e40f47614cb12b9bb1cba3c"
Sep 10 15:02:07.906476 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.906442    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"]
Sep 10 15:02:07.909890 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.909867    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.914264 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.914236    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-fd1096-openshift-default-dockercfg-qmmcl\""
Sep 10 15:02:07.922747 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.922716    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"]
Sep 10 15:02:07.995152 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-istio-token\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995426 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-credential-socket\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995426 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-socket\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995426 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-data\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995426 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj5cl\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-kube-api-access-rj5cl\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995682 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/643203ea-2834-4efc-b692-29f5a24f51b5-istio-podinfo\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995682 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/643203ea-2834-4efc-b692-29f5a24f51b5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995682 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-certs\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:07.995875 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:07.995720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-envoy\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.096861 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.096828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-envoy\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.096942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-istio-token\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.096987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-credential-socket\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-socket\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-data\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj5cl\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-kube-api-access-rj5cl\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/643203ea-2834-4efc-b692-29f5a24f51b5-istio-podinfo\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/643203ea-2834-4efc-b692-29f5a24f51b5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097327 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-certs\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097816 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097390    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-credential-socket\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097816 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-data\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097816 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-socket\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.097816 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.097598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-certs\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.098104 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.098081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/643203ea-2834-4efc-b692-29f5a24f51b5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.099145 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.099123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-envoy\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.099717 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.099681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/643203ea-2834-4efc-b692-29f5a24f51b5-istio-podinfo\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.105882 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.105854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-istio-token\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.106232 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.106211    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj5cl\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-kube-api-access-rj5cl\") pod \"e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") " pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.224986 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.224886    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:08.504398 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.504364    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"]
Sep 10 15:02:08.506402 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:02:08.506374    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643203ea_2834_4efc_b692_29f5a24f51b5.slice/crio-cb9eaffbfdc1036f4018db2d72348392d6147f3a47b7c18ff05351c3da24b2d9 WatchSource:0}: Error finding container cb9eaffbfdc1036f4018db2d72348392d6147f3a47b7c18ff05351c3da24b2d9: Status 404 returned error can't find the container with id cb9eaffbfdc1036f4018db2d72348392d6147f3a47b7c18ff05351c3da24b2d9
Sep 10 15:02:08.509124 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.509092    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:02:08.509213 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.509156    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:02:08.509213 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:08.509186    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:02:09.024880 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:09.024833    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" event={"ID":"643203ea-2834-4efc-b692-29f5a24f51b5","Type":"ContainerStarted","Data":"9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9"}
Sep 10 15:02:09.025099 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:09.024921    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" event={"ID":"643203ea-2834-4efc-b692-29f5a24f51b5","Type":"ContainerStarted","Data":"cb9eaffbfdc1036f4018db2d72348392d6147f3a47b7c18ff05351c3da24b2d9"}
Sep 10 15:02:09.045786 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:09.045725    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podStartSLOduration=2.045698117 podStartE2EDuration="2.045698117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:02:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:02:09.043480721 +0000 UTC m=+2043.507847259" watchObservedRunningTime="2026-09-10 15:02:09.045698117 +0000 UTC m=+2043.510064641"
Sep 10 15:02:09.226026 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:09.225993    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:09.227764 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:09.227732    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 10 15:02:09.227888 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:09.227794    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 10 15:02:10.229652 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:10.229610    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:11.036347 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:11.036310    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:11.037616 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:11.037587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:12.898407 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:12.898368    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"]
Sep 10 15:02:12.901044 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:12.901026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:12.904641 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:12.904617    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-fd1096\""
Sep 10 15:02:12.906499 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:12.906477    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-fd1096-dockercfg-9876p\""
Sep 10 15:02:12.913345 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:12.913318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"]
Sep 10 15:02:12.949523 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:12.949463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:12.949523 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:12.949522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b27bj\" (UniqueName: \"kubernetes.io/projected/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-kube-api-access-b27bj\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:13.051008 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:13.050972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:13.051008 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:13.051008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b27bj\" (UniqueName: \"kubernetes.io/projected/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-kube-api-access-b27bj\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:13.051631 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:13.051609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:13.059224 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:13.059198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b27bj\" (UniqueName: \"kubernetes.io/projected/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-kube-api-access-b27bj\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:13.214383 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:13.214273    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:13.489388 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:13.489323    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"]
Sep 10 15:02:13.491687 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:02:13.491654    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda32b4b6d_82ed_4fcc_9551_690bb1c7be47.slice/crio-1c1abbed17c82ac28c7007cf6e9780c367cb24140cc9bdafd1544dfda121c1bd WatchSource:0}: Error finding container 1c1abbed17c82ac28c7007cf6e9780c367cb24140cc9bdafd1544dfda121c1bd: Status 404 returned error can't find the container with id 1c1abbed17c82ac28c7007cf6e9780c367cb24140cc9bdafd1544dfda121c1bd
Sep 10 15:02:14.054981 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:14.054942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv" event={"ID":"a32b4b6d-82ed-4fcc-9551-690bb1c7be47","Type":"ContainerStarted","Data":"9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2"}
Sep 10 15:02:14.055410 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:14.055018    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:14.055410 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:14.055038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv" event={"ID":"a32b4b6d-82ed-4fcc-9551-690bb1c7be47","Type":"ContainerStarted","Data":"1c1abbed17c82ac28c7007cf6e9780c367cb24140cc9bdafd1544dfda121c1bd"}
Sep 10 15:02:14.074414 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:14.074338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv" podStartSLOduration=2.074320422 podStartE2EDuration="2.074320422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:02:14.073423994 +0000 UTC m=+2048.537790515" watchObservedRunningTime="2026-09-10 15:02:14.074320422 +0000 UTC m=+2048.538686944"
Sep 10 15:02:25.064534 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:25.064490    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:31.177024 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:31.176988    2561 generic.go:356] "Generic (PLEG): container finished" podID="643203ea-2834-4efc-b692-29f5a24f51b5" containerID="9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9" exitCode=0
Sep 10 15:02:31.177453 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:31.177063    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" event={"ID":"643203ea-2834-4efc-b692-29f5a24f51b5","Type":"ContainerDied","Data":"9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9"}
Sep 10 15:02:31.177497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:31.177465    2561 scope.go:117] "RemoveContainer" containerID="9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9"
Sep 10 15:02:31.178644 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:31.178609    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:02:31.178762 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:31.178744    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:02:31.178805 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:31.178784    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:02:32.185404 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:32.185365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" event={"ID":"643203ea-2834-4efc-b692-29f5a24f51b5","Type":"ContainerStarted","Data":"f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5"}
Sep 10 15:02:32.228177 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:32.228138    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:32.228537 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:32.228509    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 10 15:02:32.228733 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:32.228686    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 10 15:02:33.226102 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:33.226052    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 10 15:02:33.226593 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:33.226128    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 10 15:02:34.226176 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:34.225631    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 10 15:02:34.226176 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:34.225743    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 10 15:02:35.226153 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:35.226108    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 10 15:02:35.226491 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:35.226447    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 10 15:02:36.225435 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.225393    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused" start-of-body=
Sep 10 15:02:36.225766 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.225729    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.106:15021/healthz/ready\": dial tcp 10.134.0.106:15021: connect: connection refused"
Sep 10 15:02:36.680394 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.680342    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"]
Sep 10 15:02:36.683453 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.683429    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"
Sep 10 15:02:36.686389 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.686366    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 15:02:36.691659 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.691630    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"]
Sep 10 15:02:36.738444 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.738397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44ea0e4-8ff2-471f-bf36-1c625809a836-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d\" (UID: \"c44ea0e4-8ff2-471f-bf36-1c625809a836\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"
Sep 10 15:02:36.840731 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.840232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44ea0e4-8ff2-471f-bf36-1c625809a836-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d\" (UID: \"c44ea0e4-8ff2-471f-bf36-1c625809a836\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"
Sep 10 15:02:36.841731 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.841471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44ea0e4-8ff2-471f-bf36-1c625809a836-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d\" (UID: \"c44ea0e4-8ff2-471f-bf36-1c625809a836\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"
Sep 10 15:02:36.995887 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:36.995791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"
Sep 10 15:02:37.279510 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:37.279469    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"]
Sep 10 15:02:37.280915 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:02:37.280885    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44ea0e4_8ff2_471f_bf36_1c625809a836.slice/crio-7afb64bc93dafb31655440f7eb5d3c7aaccbb11cfd78a9d1ebbaedeac1355ce8 WatchSource:0}: Error finding container 7afb64bc93dafb31655440f7eb5d3c7aaccbb11cfd78a9d1ebbaedeac1355ce8: Status 404 returned error can't find the container with id 7afb64bc93dafb31655440f7eb5d3c7aaccbb11cfd78a9d1ebbaedeac1355ce8
Sep 10 15:02:37.358204 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:37.358174    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:37.358631 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:37.358602    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:37.359509 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:37.359489    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:38.222288 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:38.222252    2561 generic.go:356] "Generic (PLEG): container finished" podID="c44ea0e4-8ff2-471f-bf36-1c625809a836" containerID="0aa72f6c31a239ba917a4fa9d1a737443be75bd0952e9c3243f05c4bd91f3e9f" exitCode=0
Sep 10 15:02:38.222767 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:38.222343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d" event={"ID":"c44ea0e4-8ff2-471f-bf36-1c625809a836","Type":"ContainerDied","Data":"0aa72f6c31a239ba917a4fa9d1a737443be75bd0952e9c3243f05c4bd91f3e9f"}
Sep 10 15:02:38.222767 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:38.222410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d" event={"ID":"c44ea0e4-8ff2-471f-bf36-1c625809a836","Type":"ContainerStarted","Data":"7afb64bc93dafb31655440f7eb5d3c7aaccbb11cfd78a9d1ebbaedeac1355ce8"}
Sep 10 15:02:39.370212 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:39.370186    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"
Sep 10 15:02:39.469884 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:39.469842    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44ea0e4-8ff2-471f-bf36-1c625809a836-maas-api-service-ca\") pod \"c44ea0e4-8ff2-471f-bf36-1c625809a836\" (UID: \"c44ea0e4-8ff2-471f-bf36-1c625809a836\") "
Sep 10 15:02:39.470215 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:39.470191    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44ea0e4-8ff2-471f-bf36-1c625809a836-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c44ea0e4-8ff2-471f-bf36-1c625809a836" (UID: "c44ea0e4-8ff2-471f-bf36-1c625809a836"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:02:39.571235 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:39.571138    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c44ea0e4-8ff2-471f-bf36-1c625809a836-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:40.236760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:40.236725    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"
Sep 10 15:02:40.236760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:40.236743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d" event={"ID":"c44ea0e4-8ff2-471f-bf36-1c625809a836","Type":"ContainerDied","Data":"7afb64bc93dafb31655440f7eb5d3c7aaccbb11cfd78a9d1ebbaedeac1355ce8"}
Sep 10 15:02:40.236988 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:40.236789    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7afb64bc93dafb31655440f7eb5d3c7aaccbb11cfd78a9d1ebbaedeac1355ce8"
Sep 10 15:02:43.277397 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.277060    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"]
Sep 10 15:02:43.277397 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.277339    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv" podUID="a32b4b6d-82ed-4fcc-9551-690bb1c7be47" containerName="payload-pre-processing" containerID="cri-o://9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2" gracePeriod=30
Sep 10 15:02:43.498888 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.498850    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"]
Sep 10 15:02:43.502197 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.502173    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fd1096-7xc8d"]
Sep 10 15:02:43.539563 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.539483    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:43.623726 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.617297    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-plugins-config-volume\") pod \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") "
Sep 10 15:02:43.623726 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.617466    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b27bj\" (UniqueName: \"kubernetes.io/projected/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-kube-api-access-b27bj\") pod \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\" (UID: \"a32b4b6d-82ed-4fcc-9551-690bb1c7be47\") "
Sep 10 15:02:43.623726 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.620094    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a32b4b6d-82ed-4fcc-9551-690bb1c7be47" (UID: "a32b4b6d-82ed-4fcc-9551-690bb1c7be47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:02:43.623726 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.620645    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-kube-api-access-b27bj" (OuterVolumeSpecName: "kube-api-access-b27bj") pod "a32b4b6d-82ed-4fcc-9551-690bb1c7be47" (UID: "a32b4b6d-82ed-4fcc-9551-690bb1c7be47"). InnerVolumeSpecName "kube-api-access-b27bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:02:43.719347 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.719303    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b27bj\" (UniqueName: \"kubernetes.io/projected/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-kube-api-access-b27bj\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:43.719347 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.719336    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a32b4b6d-82ed-4fcc-9551-690bb1c7be47-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:43.994251 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:43.994215    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c44ea0e4-8ff2-471f-bf36-1c625809a836" path="/var/lib/kubelet/pods/c44ea0e4-8ff2-471f-bf36-1c625809a836/volumes"
Sep 10 15:02:44.266278 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.266183    2561 generic.go:356] "Generic (PLEG): container finished" podID="a32b4b6d-82ed-4fcc-9551-690bb1c7be47" containerID="9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2" exitCode=0
Sep 10 15:02:44.266278 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.266232    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"
Sep 10 15:02:44.266529 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.266272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv" event={"ID":"a32b4b6d-82ed-4fcc-9551-690bb1c7be47","Type":"ContainerDied","Data":"9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2"}
Sep 10 15:02:44.266529 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.266334    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv" event={"ID":"a32b4b6d-82ed-4fcc-9551-690bb1c7be47","Type":"ContainerDied","Data":"1c1abbed17c82ac28c7007cf6e9780c367cb24140cc9bdafd1544dfda121c1bd"}
Sep 10 15:02:44.266529 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.266363    2561 scope.go:117] "RemoveContainer" containerID="9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2"
Sep 10 15:02:44.276043 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.276019    2561 scope.go:117] "RemoveContainer" containerID="9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2"
Sep 10 15:02:44.276323 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:02:44.276302    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2\": container with ID starting with 9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2 not found: ID does not exist" containerID="9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2"
Sep 10 15:02:44.276375 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.276331    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2"} err="failed to get container status \"9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2\": rpc error: code = NotFound desc = could not find container \"9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2\": container with ID starting with 9e6655962d98b216397d33e7cdfb5106ed4de44dfabda2575961227134a59ca2 not found: ID does not exist"
Sep 10 15:02:44.287456 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.287432    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"]
Sep 10 15:02:44.291394 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:44.291372    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd1096-64664445cd-nbzdv"]
Sep 10 15:02:45.996041 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:45.996008    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a32b4b6d-82ed-4fcc-9551-690bb1c7be47" path="/var/lib/kubelet/pods/a32b4b6d-82ed-4fcc-9551-690bb1c7be47/volumes"
Sep 10 15:02:50.758840 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:50.758805    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"]
Sep 10 15:02:50.759335 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:50.759021    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" containerID="cri-o://f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5" gracePeriod=30
Sep 10 15:02:52.361041 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:52.361002    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:02:52.361429 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:52.361064    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:02:54.470233 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.470193    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"]
Sep 10 15:02:54.470999 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.470977    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a32b4b6d-82ed-4fcc-9551-690bb1c7be47" containerName="payload-pre-processing"
Sep 10 15:02:54.471110 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.471001    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a32b4b6d-82ed-4fcc-9551-690bb1c7be47" containerName="payload-pre-processing"
Sep 10 15:02:54.471110 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.471032    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44ea0e4-8ff2-471f-bf36-1c625809a836" containerName="revoke-keys"
Sep 10 15:02:54.471110 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.471040    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44ea0e4-8ff2-471f-bf36-1c625809a836" containerName="revoke-keys"
Sep 10 15:02:54.471272 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.471140    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c44ea0e4-8ff2-471f-bf36-1c625809a836" containerName="revoke-keys"
Sep 10 15:02:54.471272 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.471155    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a32b4b6d-82ed-4fcc-9551-690bb1c7be47" containerName="payload-pre-processing"
Sep 10 15:02:54.475791 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.475768    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"
Sep 10 15:02:54.479164 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.479136    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 15:02:54.482292 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.482241    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"]
Sep 10 15:02:54.550061 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.550011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05f9a00c-69c8-4fa4-88c1-8a9eb2382294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4\" (UID: \"05f9a00c-69c8-4fa4-88c1-8a9eb2382294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"
Sep 10 15:02:54.651267 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.651231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05f9a00c-69c8-4fa4-88c1-8a9eb2382294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4\" (UID: \"05f9a00c-69c8-4fa4-88c1-8a9eb2382294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"
Sep 10 15:02:54.652027 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.652001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05f9a00c-69c8-4fa4-88c1-8a9eb2382294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4\" (UID: \"05f9a00c-69c8-4fa4-88c1-8a9eb2382294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"
Sep 10 15:02:54.790176 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:54.790091    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"
Sep 10 15:02:55.083046 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:55.083014    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"]
Sep 10 15:02:55.084916 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:02:55.084887    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f9a00c_69c8_4fa4_88c1_8a9eb2382294.slice/crio-331fb72b31150ddb68c5e1b814ff4bf2884b57622b55150c69c483215f4c0f9b WatchSource:0}: Error finding container 331fb72b31150ddb68c5e1b814ff4bf2884b57622b55150c69c483215f4c0f9b: Status 404 returned error can't find the container with id 331fb72b31150ddb68c5e1b814ff4bf2884b57622b55150c69c483215f4c0f9b
Sep 10 15:02:55.333313 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:55.333217    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4" event={"ID":"05f9a00c-69c8-4fa4-88c1-8a9eb2382294","Type":"ContainerStarted","Data":"331fb72b31150ddb68c5e1b814ff4bf2884b57622b55150c69c483215f4c0f9b"}
Sep 10 15:02:56.034339 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.034269    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:56.169079 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169028    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-socket\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169272 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169122    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-certs\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169272 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169151    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-istio-token\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169272 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169176    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/643203ea-2834-4efc-b692-29f5a24f51b5-istio-podinfo\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169272 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169204    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj5cl\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-kube-api-access-rj5cl\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169494 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-envoy\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169494 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169366    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:02:56.169494 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169412    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-data\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169494 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169434    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:02:56.169494 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169468    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-credential-socket\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169762 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169506    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/643203ea-2834-4efc-b692-29f5a24f51b5-istiod-ca-cert\") pod \"643203ea-2834-4efc-b692-29f5a24f51b5\" (UID: \"643203ea-2834-4efc-b692-29f5a24f51b5\") "
Sep 10 15:02:56.169762 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169697    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:02:56.169762 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.169734    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:02:56.170050 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.170029    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.170136 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.170054    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.170136 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.170053    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/643203ea-2834-4efc-b692-29f5a24f51b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:02:56.170136 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.170067    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.170136 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.170108    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.171521 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.171487    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-kube-api-access-rj5cl" (OuterVolumeSpecName: "kube-api-access-rj5cl") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "kube-api-access-rj5cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:02:56.171654 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.171631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/643203ea-2834-4efc-b692-29f5a24f51b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:02:56.171986 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.171960    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:02:56.171986 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.171976    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "643203ea-2834-4efc-b692-29f5a24f51b5" (UID: "643203ea-2834-4efc-b692-29f5a24f51b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:02:56.270730 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.270670    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.270730 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.270716    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/643203ea-2834-4efc-b692-29f5a24f51b5-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.270730 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.270728    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj5cl\" (UniqueName: \"kubernetes.io/projected/643203ea-2834-4efc-b692-29f5a24f51b5-kube-api-access-rj5cl\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.270730 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.270737    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/643203ea-2834-4efc-b692-29f5a24f51b5-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.270995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.270747    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/643203ea-2834-4efc-b692-29f5a24f51b5-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:56.340626 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.340543    2561 generic.go:356] "Generic (PLEG): container finished" podID="05f9a00c-69c8-4fa4-88c1-8a9eb2382294" containerID="fb4d371407ff723dfcf68fa5bdafa575d4253cf7e7ab50ef38163c841662e875" exitCode=0
Sep 10 15:02:56.340802 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.340632    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4" event={"ID":"05f9a00c-69c8-4fa4-88c1-8a9eb2382294","Type":"ContainerDied","Data":"fb4d371407ff723dfcf68fa5bdafa575d4253cf7e7ab50ef38163c841662e875"}
Sep 10 15:02:56.342291 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.342267    2561 generic.go:356] "Generic (PLEG): container finished" podID="643203ea-2834-4efc-b692-29f5a24f51b5" containerID="f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5" exitCode=0
Sep 10 15:02:56.342412 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.342306    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"
Sep 10 15:02:56.342412 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.342327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" event={"ID":"643203ea-2834-4efc-b692-29f5a24f51b5","Type":"ContainerDied","Data":"f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5"}
Sep 10 15:02:56.342412 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.342365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7" event={"ID":"643203ea-2834-4efc-b692-29f5a24f51b5","Type":"ContainerDied","Data":"cb9eaffbfdc1036f4018db2d72348392d6147f3a47b7c18ff05351c3da24b2d9"}
Sep 10 15:02:56.342412 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.342386    2561 scope.go:117] "RemoveContainer" containerID="f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5"
Sep 10 15:02:56.352257 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.352242    2561 scope.go:117] "RemoveContainer" containerID="9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9"
Sep 10 15:02:56.361189 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.361172    2561 scope.go:117] "RemoveContainer" containerID="f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5"
Sep 10 15:02:56.361472 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:02:56.361453    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5\": container with ID starting with f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5 not found: ID does not exist" containerID="f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5"
Sep 10 15:02:56.361513 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.361482    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5"} err="failed to get container status \"f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5\": rpc error: code = NotFound desc = could not find container \"f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5\": container with ID starting with f7321faca85d929edf9c771304f7797e06fd3f430f843f5c8770bbe56b403cb5 not found: ID does not exist"
Sep 10 15:02:56.361513 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.361499    2561 scope.go:117] "RemoveContainer" containerID="9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9"
Sep 10 15:02:56.361778 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:02:56.361758    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9\": container with ID starting with 9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9 not found: ID does not exist" containerID="9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9"
Sep 10 15:02:56.361862 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.361786    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9"} err="failed to get container status \"9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9\": rpc error: code = NotFound desc = could not find container \"9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9\": container with ID starting with 9143d2f36e151524a50168f5f24229a3f1f4cb5877f9b2f90fb0bd294f366df9 not found: ID does not exist"
Sep 10 15:02:56.371654 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.371628    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"]
Sep 10 15:02:56.379012 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:56.378984    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd1096-openshift-default-87b5c6956-dbdr7"]
Sep 10 15:02:57.491199 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:57.491173    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"
Sep 10 15:02:57.587315 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:57.587280    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05f9a00c-69c8-4fa4-88c1-8a9eb2382294-maas-api-service-ca\") pod \"05f9a00c-69c8-4fa4-88c1-8a9eb2382294\" (UID: \"05f9a00c-69c8-4fa4-88c1-8a9eb2382294\") "
Sep 10 15:02:57.587668 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:57.587643    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f9a00c-69c8-4fa4-88c1-8a9eb2382294-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05f9a00c-69c8-4fa4-88c1-8a9eb2382294" (UID: "05f9a00c-69c8-4fa4-88c1-8a9eb2382294"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:02:57.688487 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:57.688451    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05f9a00c-69c8-4fa4-88c1-8a9eb2382294-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:02:57.996341 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:57.996242    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" path="/var/lib/kubelet/pods/643203ea-2834-4efc-b692-29f5a24f51b5/volumes"
Sep 10 15:02:58.356579 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:58.356479    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"
Sep 10 15:02:58.356579 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:58.356519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4" event={"ID":"05f9a00c-69c8-4fa4-88c1-8a9eb2382294","Type":"ContainerDied","Data":"331fb72b31150ddb68c5e1b814ff4bf2884b57622b55150c69c483215f4c0f9b"}
Sep 10 15:02:58.356579 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:02:58.356575    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="331fb72b31150ddb68c5e1b814ff4bf2884b57622b55150c69c483215f4c0f9b"
Sep 10 15:03:07.100116 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:03:07.100081    2561 scope.go:117] "RemoveContainer" containerID="0a5fdfcbb89e66e5b53daa4564a08482e9ea9da81ab7158697bf78883e74c971"
Sep 10 15:03:10.319000 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:03:10.318962    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"]
Sep 10 15:03:10.323084 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:03:10.323049    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ae0f24-nfsd4"]
Sep 10 15:03:11.994642 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:03:11.994604    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05f9a00c-69c8-4fa4-88c1-8a9eb2382294" path="/var/lib/kubelet/pods/05f9a00c-69c8-4fa4-88c1-8a9eb2382294/volumes"
Sep 10 15:04:01.822149 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:01.822052    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"]
Sep 10 15:04:01.822676 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:01.822293    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy" containerID="cri-o://07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d" gracePeriod=30
Sep 10 15:04:02.190285 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190248    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"]
Sep 10 15:04:02.190761 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190745    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy"
Sep 10 15:04:02.190761 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190762    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy"
Sep 10 15:04:02.190884 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190782    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f9a00c-69c8-4fa4-88c1-8a9eb2382294" containerName="revoke-keys"
Sep 10 15:04:02.190884 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190788    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f9a00c-69c8-4fa4-88c1-8a9eb2382294" containerName="revoke-keys"
Sep 10 15:04:02.190884 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190871    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy"
Sep 10 15:04:02.190884 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190880    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy"
Sep 10 15:04:02.191008 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.190889    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f9a00c-69c8-4fa4-88c1-8a9eb2382294" containerName="revoke-keys"
Sep 10 15:04:02.194086 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.194070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"
Sep 10 15:04:02.196805 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.196784    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 15:04:02.203800 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.203764    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"]
Sep 10 15:04:02.288699 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.288654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7e5529-e1b5-41c5-b586-115c7ea6d6be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r\" (UID: \"1c7e5529-e1b5-41c5-b586-115c7ea6d6be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"
Sep 10 15:04:02.390213 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.390179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7e5529-e1b5-41c5-b586-115c7ea6d6be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r\" (UID: \"1c7e5529-e1b5-41c5-b586-115c7ea6d6be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"
Sep 10 15:04:02.390875 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.390845    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7e5529-e1b5-41c5-b586-115c7ea6d6be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r\" (UID: \"1c7e5529-e1b5-41c5-b586-115c7ea6d6be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"
Sep 10 15:04:02.505921 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.505826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"
Sep 10 15:04:02.795717 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:02.795611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"]
Sep 10 15:04:02.799968 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:04:02.799935    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7e5529_e1b5_41c5_b586_115c7ea6d6be.slice/crio-d14cc7c2c622613c6862bf6f2a681154a0e367902214d72322baab0ea1027f4d WatchSource:0}: Error finding container d14cc7c2c622613c6862bf6f2a681154a0e367902214d72322baab0ea1027f4d: Status 404 returned error can't find the container with id d14cc7c2c622613c6862bf6f2a681154a0e367902214d72322baab0ea1027f4d
Sep 10 15:04:03.754472 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:03.754437    2561 generic.go:356] "Generic (PLEG): container finished" podID="1c7e5529-e1b5-41c5-b586-115c7ea6d6be" containerID="12ad1754268706189deecbd42f9a8efcd048ded7d2af38ff2d51c5337b26f37d" exitCode=0
Sep 10 15:04:03.754893 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:03.754528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r" event={"ID":"1c7e5529-e1b5-41c5-b586-115c7ea6d6be","Type":"ContainerDied","Data":"12ad1754268706189deecbd42f9a8efcd048ded7d2af38ff2d51c5337b26f37d"}
Sep 10 15:04:03.754893 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:03.754583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r" event={"ID":"1c7e5529-e1b5-41c5-b586-115c7ea6d6be","Type":"ContainerStarted","Data":"d14cc7c2c622613c6862bf6f2a681154a0e367902214d72322baab0ea1027f4d"}
Sep 10 15:04:04.906935 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:04.906905    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"
Sep 10 15:04:05.018578 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:05.018457    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7e5529-e1b5-41c5-b586-115c7ea6d6be-maas-api-service-ca\") pod \"1c7e5529-e1b5-41c5-b586-115c7ea6d6be\" (UID: \"1c7e5529-e1b5-41c5-b586-115c7ea6d6be\") "
Sep 10 15:04:05.018887 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:05.018863    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c7e5529-e1b5-41c5-b586-115c7ea6d6be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c7e5529-e1b5-41c5-b586-115c7ea6d6be" (UID: "1c7e5529-e1b5-41c5-b586-115c7ea6d6be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:05.119555 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:05.119500    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7e5529-e1b5-41c5-b586-115c7ea6d6be-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:05.773256 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:05.773224    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"
Sep 10 15:04:05.773436 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:05.773271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r" event={"ID":"1c7e5529-e1b5-41c5-b586-115c7ea6d6be","Type":"ContainerDied","Data":"d14cc7c2c622613c6862bf6f2a681154a0e367902214d72322baab0ea1027f4d"}
Sep 10 15:04:05.773436 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:05.773323    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d14cc7c2c622613c6862bf6f2a681154a0e367902214d72322baab0ea1027f4d"
Sep 10 15:04:07.090030 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.089964    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:04:07.241430 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241400    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-podinfo\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.241622 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241448    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-envoy\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.241622 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241480    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-certs\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.241622 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241509    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pcdn\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-kube-api-access-9pcdn\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.241622 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241543    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-data\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.241622 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241594    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-socket\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.242030 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241626    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istiod-ca-cert\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.242030 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241690    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-token\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.242030 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-credential-socket\") pod \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\" (UID: \"bc6df0c4-f9d4-4d13-9f03-66f46139e361\") "
Sep 10 15:04:07.242030 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.241812    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:07.242030 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.242021    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:07.242293 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.242108    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:07.242293 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.242285    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.242409 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.242307    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.242409 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.242317    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.242409 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.242343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:07.242574 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.242415    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:07.243810 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.243779    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-kube-api-access-9pcdn" (OuterVolumeSpecName: "kube-api-access-9pcdn") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "kube-api-access-9pcdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:07.243921 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.243816    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:07.244108 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.244084    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:04:07.244108 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.244095    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc6df0c4-f9d4-4d13-9f03-66f46139e361" (UID: "bc6df0c4-f9d4-4d13-9f03-66f46139e361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:07.343504 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.343413    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.343504 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.343441    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.343504 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.343451    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.343504 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.343459    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.343504 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.343467    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pcdn\" (UniqueName: \"kubernetes.io/projected/bc6df0c4-f9d4-4d13-9f03-66f46139e361-kube-api-access-9pcdn\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.343504 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.343475    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6df0c4-f9d4-4d13-9f03-66f46139e361-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:07.787752 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.787689    2561 generic.go:356] "Generic (PLEG): container finished" podID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerID="07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d" exitCode=0
Sep 10 15:04:07.787752 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.787759    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"
Sep 10 15:04:07.787995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.787779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" event={"ID":"bc6df0c4-f9d4-4d13-9f03-66f46139e361","Type":"ContainerDied","Data":"07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d"}
Sep 10 15:04:07.787995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.787839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d" event={"ID":"bc6df0c4-f9d4-4d13-9f03-66f46139e361","Type":"ContainerDied","Data":"7cea254d372e7b422c152aed8b9d39728cdcbd9723edbfe6da4a761a58bcb866"}
Sep 10 15:04:07.787995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.787867    2561 scope.go:117] "RemoveContainer" containerID="07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d"
Sep 10 15:04:07.798216 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.798197    2561 scope.go:117] "RemoveContainer" containerID="80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a"
Sep 10 15:04:07.806515 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.806494    2561 scope.go:117] "RemoveContainer" containerID="07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d"
Sep 10 15:04:07.806826 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:07.806804    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d\": container with ID starting with 07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d not found: ID does not exist" containerID="07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d"
Sep 10 15:04:07.806891 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.806835    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d"} err="failed to get container status \"07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d\": rpc error: code = NotFound desc = could not find container \"07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d\": container with ID starting with 07f949783551bbc97495ec594c0498761e7440097864c349771b273b152f5f9d not found: ID does not exist"
Sep 10 15:04:07.806891 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.806854    2561 scope.go:117] "RemoveContainer" containerID="80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a"
Sep 10 15:04:07.807128 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:07.807109    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a\": container with ID starting with 80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a not found: ID does not exist" containerID="80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a"
Sep 10 15:04:07.807182 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.807138    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a"} err="failed to get container status \"80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a\": rpc error: code = NotFound desc = could not find container \"80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a\": container with ID starting with 80901af0dad219f2b75cbac851cf7fbe24ece273613cc1e9bee8c30e9a6a242a not found: ID does not exist"
Sep 10 15:04:07.818953 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.818925    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"]
Sep 10 15:04:07.825486 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.825454    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ae0f24-openshift-default-5dd7cb9d54-wsp4d"]
Sep 10 15:04:07.994440 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:07.994411    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" path="/var/lib/kubelet/pods/bc6df0c4-f9d4-4d13-9f03-66f46139e361/volumes"
Sep 10 15:04:13.410657 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:13.410622    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"]
Sep 10 15:04:13.415306 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:13.415272    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b8f4d6-v625r"]
Sep 10 15:04:13.994201 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:13.994164    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7e5529-e1b5-41c5-b586-115c7ea6d6be" path="/var/lib/kubelet/pods/1c7e5529-e1b5-41c5-b586-115c7ea6d6be/volumes"
Sep 10 15:04:21.617791 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:21.617747    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"]
Sep 10 15:04:21.618295 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:21.617996    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy" containerID="cri-o://4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d" gracePeriod=30
Sep 10 15:04:22.033729 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.033672    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"]
Sep 10 15:04:22.034172 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034158    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy"
Sep 10 15:04:22.034219 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034174    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy"
Sep 10 15:04:22.034219 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034202    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy"
Sep 10 15:04:22.034219 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034209    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy"
Sep 10 15:04:22.034326 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034237    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7e5529-e1b5-41c5-b586-115c7ea6d6be" containerName="revoke-keys"
Sep 10 15:04:22.034326 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034244    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7e5529-e1b5-41c5-b586-115c7ea6d6be" containerName="revoke-keys"
Sep 10 15:04:22.034326 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034253    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy"
Sep 10 15:04:22.034326 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034258    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="643203ea-2834-4efc-b692-29f5a24f51b5" containerName="istio-proxy"
Sep 10 15:04:22.034447 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034334    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy"
Sep 10 15:04:22.034447 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.034343    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7e5529-e1b5-41c5-b586-115c7ea6d6be" containerName="revoke-keys"
Sep 10 15:04:22.037742 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.037724    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"
Sep 10 15:04:22.047400 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.047378    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 15:04:22.066088 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.066057    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"]
Sep 10 15:04:22.110455 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.110419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b29e63-6c72-4dc6-a321-26ff60a555ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr\" (UID: \"79b29e63-6c72-4dc6-a321-26ff60a555ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"
Sep 10 15:04:22.211357 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.211313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b29e63-6c72-4dc6-a321-26ff60a555ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr\" (UID: \"79b29e63-6c72-4dc6-a321-26ff60a555ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"
Sep 10 15:04:22.212047 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.212027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b29e63-6c72-4dc6-a321-26ff60a555ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr\" (UID: \"79b29e63-6c72-4dc6-a321-26ff60a555ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"
Sep 10 15:04:22.348655 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.348559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"
Sep 10 15:04:22.663951 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.663920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"]
Sep 10 15:04:22.665043 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:04:22.665013    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b29e63_6c72_4dc6_a321_26ff60a555ba.slice/crio-9a147ab4aeca25002c942690a9df14086a304054030dedc8214e224f958d0190 WatchSource:0}: Error finding container 9a147ab4aeca25002c942690a9df14086a304054030dedc8214e224f958d0190: Status 404 returned error can't find the container with id 9a147ab4aeca25002c942690a9df14086a304054030dedc8214e224f958d0190
Sep 10 15:04:22.882809 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:22.882770    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr" event={"ID":"79b29e63-6c72-4dc6-a321-26ff60a555ba","Type":"ContainerStarted","Data":"9a147ab4aeca25002c942690a9df14086a304054030dedc8214e224f958d0190"}
Sep 10 15:04:23.890334 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:23.890241    2561 generic.go:356] "Generic (PLEG): container finished" podID="79b29e63-6c72-4dc6-a321-26ff60a555ba" containerID="e27c7ff12297b1356dc39c6a30a5c7ff71dedf5e276abf74938567bffdcd19e4" exitCode=0
Sep 10 15:04:23.890721 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:23.890331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr" event={"ID":"79b29e63-6c72-4dc6-a321-26ff60a555ba","Type":"ContainerDied","Data":"e27c7ff12297b1356dc39c6a30a5c7ff71dedf5e276abf74938567bffdcd19e4"}
Sep 10 15:04:25.040127 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:25.040103    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"
Sep 10 15:04:25.147530 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:25.147422    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b29e63-6c72-4dc6-a321-26ff60a555ba-maas-api-service-ca\") pod \"79b29e63-6c72-4dc6-a321-26ff60a555ba\" (UID: \"79b29e63-6c72-4dc6-a321-26ff60a555ba\") "
Sep 10 15:04:25.147866 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:25.147837    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79b29e63-6c72-4dc6-a321-26ff60a555ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79b29e63-6c72-4dc6-a321-26ff60a555ba" (UID: "79b29e63-6c72-4dc6-a321-26ff60a555ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:25.249118 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:25.249084    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b29e63-6c72-4dc6-a321-26ff60a555ba-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:25.904522 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:25.904481    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr" event={"ID":"79b29e63-6c72-4dc6-a321-26ff60a555ba","Type":"ContainerDied","Data":"9a147ab4aeca25002c942690a9df14086a304054030dedc8214e224f958d0190"}
Sep 10 15:04:25.904810 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:25.904503    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"
Sep 10 15:04:25.904810 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:25.904582    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a147ab4aeca25002c942690a9df14086a304054030dedc8214e224f958d0190"
Sep 10 15:04:26.875810 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.875782    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:04:26.911084 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.911052    2561 generic.go:356] "Generic (PLEG): container finished" podID="812c077d-be48-4d3b-aa31-e10dda927a44" containerID="4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d" exitCode=0
Sep 10 15:04:26.911230 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.911104    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"
Sep 10 15:04:26.911230 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.911133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" event={"ID":"812c077d-be48-4d3b-aa31-e10dda927a44","Type":"ContainerDied","Data":"4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d"}
Sep 10 15:04:26.911230 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.911193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58" event={"ID":"812c077d-be48-4d3b-aa31-e10dda927a44","Type":"ContainerDied","Data":"b895968ed641e9a8e98427761b124340d22aba0690636760909c34bebf9d7ada"}
Sep 10 15:04:26.911230 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.911210    2561 scope.go:117] "RemoveContainer" containerID="4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d"
Sep 10 15:04:26.920330 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.920309    2561 scope.go:117] "RemoveContainer" containerID="6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63"
Sep 10 15:04:26.932302 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.932279    2561 scope.go:117] "RemoveContainer" containerID="4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d"
Sep 10 15:04:26.932653 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:26.932631    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d\": container with ID starting with 4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d not found: ID does not exist" containerID="4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d"
Sep 10 15:04:26.932724 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.932662    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d"} err="failed to get container status \"4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d\": rpc error: code = NotFound desc = could not find container \"4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d\": container with ID starting with 4ae4e00f152ecbb5d42ea4f6abd027aac98cb2309b8375de98b0cb85b2495e6d not found: ID does not exist"
Sep 10 15:04:26.932724 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.932682    2561 scope.go:117] "RemoveContainer" containerID="6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63"
Sep 10 15:04:26.933073 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:26.933049    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63\": container with ID starting with 6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63 not found: ID does not exist" containerID="6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63"
Sep 10 15:04:26.933166 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.933077    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63"} err="failed to get container status \"6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63\": rpc error: code = NotFound desc = could not find container \"6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63\": container with ID starting with 6856a0169af4c7c0ed50b9868a651ea203c1e3d6a935b7acabfe4a5d11d5bb63 not found: ID does not exist"
Sep 10 15:04:26.966154 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-certs\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966314 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966162    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfjz9\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-kube-api-access-cfjz9\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966314 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966191    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-data\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966314 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966222    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-istio-token\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966314 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966263    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-envoy\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966604 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966360    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812c077d-be48-4d3b-aa31-e10dda927a44-istiod-ca-cert\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966604 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966388    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812c077d-be48-4d3b-aa31-e10dda927a44-istio-podinfo\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966604 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966398    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:26.966604 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-credential-socket\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966604 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966514    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-socket\") pod \"812c077d-be48-4d3b-aa31-e10dda927a44\" (UID: \"812c077d-be48-4d3b-aa31-e10dda927a44\") "
Sep 10 15:04:26.966604 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966568    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-data" (OuterVolumeSpecName: "istio-data") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:26.966944 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966784    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812c077d-be48-4d3b-aa31-e10dda927a44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:26.966944 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.966873    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:26.967071 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.967049    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:26.967139 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.967057    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:26.967139 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.967095    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:26.967139 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.967112    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:26.967139 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.967124    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812c077d-be48-4d3b-aa31-e10dda927a44-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:26.968584 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.968556    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-istio-token" (OuterVolumeSpecName: "istio-token") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:26.968584 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.968571    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-kube-api-access-cfjz9" (OuterVolumeSpecName: "kube-api-access-cfjz9") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "kube-api-access-cfjz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:26.968584 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.968551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:26.968846 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:26.968592    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/812c077d-be48-4d3b-aa31-e10dda927a44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "812c077d-be48-4d3b-aa31-e10dda927a44" (UID: "812c077d-be48-4d3b-aa31-e10dda927a44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:04:27.068208 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.068151    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:27.068208 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.068201    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:27.068208 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.068211    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812c077d-be48-4d3b-aa31-e10dda927a44-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:27.068208 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.068222    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812c077d-be48-4d3b-aa31-e10dda927a44-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:27.068208 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.068230    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfjz9\" (UniqueName: \"kubernetes.io/projected/812c077d-be48-4d3b-aa31-e10dda927a44-kube-api-access-cfjz9\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:27.238441 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.238403    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"]
Sep 10 15:04:27.242536 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.242506    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b8f4d6-openshift-default-d4c86bb4d-lmq58"]
Sep 10 15:04:27.994944 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:27.994910    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" path="/var/lib/kubelet/pods/812c077d-be48-4d3b-aa31-e10dda927a44/volumes"
Sep 10 15:04:33.418844 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:33.418804    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"]
Sep 10 15:04:33.424799 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:33.424768    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-12b6f6-cfdvr"]
Sep 10 15:04:33.994444 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:33.994407    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b29e63-6c72-4dc6-a321-26ff60a555ba" path="/var/lib/kubelet/pods/79b29e63-6c72-4dc6-a321-26ff60a555ba/volumes"
Sep 10 15:04:40.644869 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:40.644826    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"]
Sep 10 15:04:40.645298 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:40.645062    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" containerID="cri-o://85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909" gracePeriod=30
Sep 10 15:04:41.015939 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.015907    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"]
Sep 10 15:04:41.016378 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016365    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy"
Sep 10 15:04:41.016475 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016380    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy"
Sep 10 15:04:41.016475 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016400    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b29e63-6c72-4dc6-a321-26ff60a555ba" containerName="revoke-keys"
Sep 10 15:04:41.016475 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016406    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b29e63-6c72-4dc6-a321-26ff60a555ba" containerName="revoke-keys"
Sep 10 15:04:41.016475 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016416    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy"
Sep 10 15:04:41.016475 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016421    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy"
Sep 10 15:04:41.016630 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016486    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b29e63-6c72-4dc6-a321-26ff60a555ba" containerName="revoke-keys"
Sep 10 15:04:41.016630 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016495    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy"
Sep 10 15:04:41.016630 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.016504    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6df0c4-f9d4-4d13-9f03-66f46139e361" containerName="istio-proxy"
Sep 10 15:04:41.021310 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.021293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"
Sep 10 15:04:41.026527 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.026506    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gd94c\""
Sep 10 15:04:41.056778 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.056744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"]
Sep 10 15:04:41.109616 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.109579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0f79c28-5394-42c3-beac-141f0a1ed807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp\" (UID: \"a0f79c28-5394-42c3-beac-141f0a1ed807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"
Sep 10 15:04:41.211010 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.210970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0f79c28-5394-42c3-beac-141f0a1ed807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp\" (UID: \"a0f79c28-5394-42c3-beac-141f0a1ed807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"
Sep 10 15:04:41.211658 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.211630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0f79c28-5394-42c3-beac-141f0a1ed807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp\" (UID: \"a0f79c28-5394-42c3-beac-141f0a1ed807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"
Sep 10 15:04:41.332198 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.332120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"
Sep 10 15:04:41.619340 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:41.613322    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"]
Sep 10 15:04:41.621242 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:04:41.621211    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f79c28_5394_42c3_beac_141f0a1ed807.slice/crio-b0e60243e9250123b657260dfba71c910b9933f6f47722bf85e23b06e5455b7e WatchSource:0}: Error finding container b0e60243e9250123b657260dfba71c910b9933f6f47722bf85e23b06e5455b7e: Status 404 returned error can't find the container with id b0e60243e9250123b657260dfba71c910b9933f6f47722bf85e23b06e5455b7e
Sep 10 15:04:42.001680 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:42.001627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp" event={"ID":"a0f79c28-5394-42c3-beac-141f0a1ed807","Type":"ContainerStarted","Data":"605fc9e04e7159ce50aadc97e8c09424f1b58f36990c5f9fe79a6730288841b9"}
Sep 10 15:04:42.002097 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:42.001714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp" event={"ID":"a0f79c28-5394-42c3-beac-141f0a1ed807","Type":"ContainerStarted","Data":"b0e60243e9250123b657260dfba71c910b9933f6f47722bf85e23b06e5455b7e"}
Sep 10 15:04:42.030952 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:42.030895    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp" podStartSLOduration=2.030878507 podStartE2EDuration="2.030878507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:04:42.027180213 +0000 UTC m=+2196.491546750" watchObservedRunningTime="2026-09-10 15:04:42.030878507 +0000 UTC m=+2196.495245043"
Sep 10 15:04:43.008781 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:43.008741    2561 generic.go:356] "Generic (PLEG): container finished" podID="a0f79c28-5394-42c3-beac-141f0a1ed807" containerID="605fc9e04e7159ce50aadc97e8c09424f1b58f36990c5f9fe79a6730288841b9" exitCode=0
Sep 10 15:04:43.009239 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:43.008829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp" event={"ID":"a0f79c28-5394-42c3-beac-141f0a1ed807","Type":"ContainerDied","Data":"605fc9e04e7159ce50aadc97e8c09424f1b58f36990c5f9fe79a6730288841b9"}
Sep 10 15:04:44.157729 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:44.157682    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"
Sep 10 15:04:44.245515 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:44.245471    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0f79c28-5394-42c3-beac-141f0a1ed807-maas-api-service-ca\") pod \"a0f79c28-5394-42c3-beac-141f0a1ed807\" (UID: \"a0f79c28-5394-42c3-beac-141f0a1ed807\") "
Sep 10 15:04:44.245880 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:44.245851    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0f79c28-5394-42c3-beac-141f0a1ed807-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a0f79c28-5394-42c3-beac-141f0a1ed807" (UID: "a0f79c28-5394-42c3-beac-141f0a1ed807"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:44.346959 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:44.346866    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0f79c28-5394-42c3-beac-141f0a1ed807-maas-api-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:44.987565 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:44.987527    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:04:44.987764 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:44.987590    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:04:45.021190 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.021158    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"
Sep 10 15:04:45.021190 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.021168    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp" event={"ID":"a0f79c28-5394-42c3-beac-141f0a1ed807","Type":"ContainerDied","Data":"b0e60243e9250123b657260dfba71c910b9933f6f47722bf85e23b06e5455b7e"}
Sep 10 15:04:45.021399 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.021209    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0e60243e9250123b657260dfba71c910b9933f6f47722bf85e23b06e5455b7e"
Sep 10 15:04:45.909651 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.909583    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 15:04:45.963353 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963311    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-data\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963541 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963373    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-socket\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963541 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963437    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-certs\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963541 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f62q\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-kube-api-access-8f62q\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963541 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963513    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-istio-token\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50a5aba-62b6-413f-8541-5d4699636507-istiod-ca-cert\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963597    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-envoy\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963629    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-credential-socket\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963632    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-data" (OuterVolumeSpecName: "istio-data") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:45.963760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50a5aba-62b6-413f-8541-5d4699636507-istio-podinfo\") pod \"b50a5aba-62b6-413f-8541-5d4699636507\" (UID: \"b50a5aba-62b6-413f-8541-5d4699636507\") "
Sep 10 15:04:45.963760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:45.964070 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.963827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:45.964128 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.964049    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b50a5aba-62b6-413f-8541-5d4699636507-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:45.964242 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.964213    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:45.964374 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.964304    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:45.964374 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.964329    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50a5aba-62b6-413f-8541-5d4699636507-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:45.964374 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.964341    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:45.964374 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.964350    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:45.966055 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.966033    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:04:45.966152 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.966037    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-istio-token" (OuterVolumeSpecName: "istio-token") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:45.966277 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.966254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b50a5aba-62b6-413f-8541-5d4699636507-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:04:45.966277 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:45.966265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-kube-api-access-8f62q" (OuterVolumeSpecName: "kube-api-access-8f62q") pod "b50a5aba-62b6-413f-8541-5d4699636507" (UID: "b50a5aba-62b6-413f-8541-5d4699636507"). InnerVolumeSpecName "kube-api-access-8f62q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:46.028262 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.028222    2561 generic.go:356] "Generic (PLEG): container finished" podID="b50a5aba-62b6-413f-8541-5d4699636507" containerID="85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909" exitCode=0
Sep 10 15:04:46.028428 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.028277    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"
Sep 10 15:04:46.028428 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.028282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" event={"ID":"b50a5aba-62b6-413f-8541-5d4699636507","Type":"ContainerDied","Data":"85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909"}
Sep 10 15:04:46.028428 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.028335    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb" event={"ID":"b50a5aba-62b6-413f-8541-5d4699636507","Type":"ContainerDied","Data":"bfccf8521877f8f632617b4ad9149518186dc2bdc9a2c34181eb62cc1ba6c422"}
Sep 10 15:04:46.028428 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.028358    2561 scope.go:117] "RemoveContainer" containerID="85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909"
Sep 10 15:04:46.037841 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.037816    2561 scope.go:117] "RemoveContainer" containerID="af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25"
Sep 10 15:04:46.046346 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.046325    2561 scope.go:117] "RemoveContainer" containerID="85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909"
Sep 10 15:04:46.046634 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:46.046614    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909\": container with ID starting with 85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909 not found: ID does not exist" containerID="85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909"
Sep 10 15:04:46.046687 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.046647    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909"} err="failed to get container status \"85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909\": rpc error: code = NotFound desc = could not find container \"85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909\": container with ID starting with 85fe61cf5b6c67be53c281ad740939cce136ab1895243529e8c0b58bc224f909 not found: ID does not exist"
Sep 10 15:04:46.046687 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.046672    2561 scope.go:117] "RemoveContainer" containerID="af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25"
Sep 10 15:04:46.046962 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:46.046947    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25\": container with ID starting with af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25 not found: ID does not exist" containerID="af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25"
Sep 10 15:04:46.047021 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.046964    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25"} err="failed to get container status \"af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25\": rpc error: code = NotFound desc = could not find container \"af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25\": container with ID starting with af9e104ee365d8afe279a1e5bdadd7f11ad521e1b7b230853c9b021b222a2c25 not found: ID does not exist"
Sep 10 15:04:46.057970 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.057931    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"]
Sep 10 15:04:46.065512 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.065481    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f62q\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-kube-api-access-8f62q\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:46.065512 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.065513    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50a5aba-62b6-413f-8541-5d4699636507-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:46.065685 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.065531    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:46.065685 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.065545    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50a5aba-62b6-413f-8541-5d4699636507-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:46.065685 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.065558    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50a5aba-62b6-413f-8541-5d4699636507-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:46.070069 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:46.070044    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-12b6f6-openshift-default-5f8db5444b-qphsb"]
Sep 10 15:04:47.994851 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:47.994811    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b50a5aba-62b6-413f-8541-5d4699636507" path="/var/lib/kubelet/pods/b50a5aba-62b6-413f-8541-5d4699636507/volumes"
Sep 10 15:04:52.190751 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.190693    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"]
Sep 10 15:04:52.202988 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.202954    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e6941c-29817540-7m8hl"]
Sep 10 15:04:52.293937 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.293890    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"]
Sep 10 15:04:52.294209 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.294178    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk" podUID="691545f2-d651-426f-beb4-2da71de50eff" containerName="payload-processing" containerID="cri-o://7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860" gracePeriod=30
Sep 10 15:04:52.297594 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.297559    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"]
Sep 10 15:04:52.298149 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.298094    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr" podUID="279e395a-e7a4-40b3-a45d-7f841df6c6df" containerName="payload-pre-processing" containerID="cri-o://37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8" gracePeriod=30
Sep 10 15:04:52.592566 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.592522    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 15:04:52.596847 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.596814    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 15:04:52.737058 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.735864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/691545f2-d651-426f-beb4-2da71de50eff-plugins-config-volume\") pod \"691545f2-d651-426f-beb4-2da71de50eff\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") "
Sep 10 15:04:52.737058 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.735983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsmtm\" (UniqueName: \"kubernetes.io/projected/691545f2-d651-426f-beb4-2da71de50eff-kube-api-access-jsmtm\") pod \"691545f2-d651-426f-beb4-2da71de50eff\" (UID: \"691545f2-d651-426f-beb4-2da71de50eff\") "
Sep 10 15:04:52.737058 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.736052    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsxwv\" (UniqueName: \"kubernetes.io/projected/279e395a-e7a4-40b3-a45d-7f841df6c6df-kube-api-access-wsxwv\") pod \"279e395a-e7a4-40b3-a45d-7f841df6c6df\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") "
Sep 10 15:04:52.737058 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.736119    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279e395a-e7a4-40b3-a45d-7f841df6c6df-plugins-config-volume\") pod \"279e395a-e7a4-40b3-a45d-7f841df6c6df\" (UID: \"279e395a-e7a4-40b3-a45d-7f841df6c6df\") "
Sep 10 15:04:52.737058 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.737040    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/691545f2-d651-426f-beb4-2da71de50eff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "691545f2-d651-426f-beb4-2da71de50eff" (UID: "691545f2-d651-426f-beb4-2da71de50eff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:52.737412 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.737217    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279e395a-e7a4-40b3-a45d-7f841df6c6df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "279e395a-e7a4-40b3-a45d-7f841df6c6df" (UID: "279e395a-e7a4-40b3-a45d-7f841df6c6df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:04:52.739798 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.739759    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279e395a-e7a4-40b3-a45d-7f841df6c6df-kube-api-access-wsxwv" (OuterVolumeSpecName: "kube-api-access-wsxwv") pod "279e395a-e7a4-40b3-a45d-7f841df6c6df" (UID: "279e395a-e7a4-40b3-a45d-7f841df6c6df"). InnerVolumeSpecName "kube-api-access-wsxwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:52.739798 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.739783    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691545f2-d651-426f-beb4-2da71de50eff-kube-api-access-jsmtm" (OuterVolumeSpecName: "kube-api-access-jsmtm") pod "691545f2-d651-426f-beb4-2da71de50eff" (UID: "691545f2-d651-426f-beb4-2da71de50eff"). InnerVolumeSpecName "kube-api-access-jsmtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:04:52.837526 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.837484    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsxwv\" (UniqueName: \"kubernetes.io/projected/279e395a-e7a4-40b3-a45d-7f841df6c6df-kube-api-access-wsxwv\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:52.837526 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.837522    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279e395a-e7a4-40b3-a45d-7f841df6c6df-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:52.837526 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.837532    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/691545f2-d651-426f-beb4-2da71de50eff-plugins-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:52.837796 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.837542    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsmtm\" (UniqueName: \"kubernetes.io/projected/691545f2-d651-426f-beb4-2da71de50eff-kube-api-access-jsmtm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:04:52.885622 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.885579    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"]
Sep 10 15:04:52.891068 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:52.891035    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e6941c-mxcpp"]
Sep 10 15:04:53.071948 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.071840    2561 generic.go:356] "Generic (PLEG): container finished" podID="691545f2-d651-426f-beb4-2da71de50eff" containerID="7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860" exitCode=0
Sep 10 15:04:53.071948 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.071883    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"
Sep 10 15:04:53.071948 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.071928    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk" event={"ID":"691545f2-d651-426f-beb4-2da71de50eff","Type":"ContainerDied","Data":"7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860"}
Sep 10 15:04:53.072237 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.071985    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk" event={"ID":"691545f2-d651-426f-beb4-2da71de50eff","Type":"ContainerDied","Data":"7c7a9f9a64ef5f4f25b82ec99914a22832c7d0e68b1731642313709e3c488828"}
Sep 10 15:04:53.072237 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.072008    2561 scope.go:117] "RemoveContainer" containerID="7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860"
Sep 10 15:04:53.073490 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.073462    2561 generic.go:356] "Generic (PLEG): container finished" podID="279e395a-e7a4-40b3-a45d-7f841df6c6df" containerID="37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8" exitCode=0
Sep 10 15:04:53.073606 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.073502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr" event={"ID":"279e395a-e7a4-40b3-a45d-7f841df6c6df","Type":"ContainerDied","Data":"37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8"}
Sep 10 15:04:53.073606 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.073513    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"
Sep 10 15:04:53.073606 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.073542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr" event={"ID":"279e395a-e7a4-40b3-a45d-7f841df6c6df","Type":"ContainerDied","Data":"b6de24489598a64b168c4c87f49ec2a82660ff07b87920037dface619c81f093"}
Sep 10 15:04:53.081588 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.081550    2561 scope.go:117] "RemoveContainer" containerID="7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860"
Sep 10 15:04:53.082029 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:53.082002    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860\": container with ID starting with 7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860 not found: ID does not exist" containerID="7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860"
Sep 10 15:04:53.082077 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.082045    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860"} err="failed to get container status \"7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860\": rpc error: code = NotFound desc = could not find container \"7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860\": container with ID starting with 7f92f678ad34982d2e847dbab95a102c486dd78c44b4b56f3f0a5ce04dd0a860 not found: ID does not exist"
Sep 10 15:04:53.082116 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.082075    2561 scope.go:117] "RemoveContainer" containerID="37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8"
Sep 10 15:04:53.091794 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.091771    2561 scope.go:117] "RemoveContainer" containerID="37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8"
Sep 10 15:04:53.092113 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:04:53.092097    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8\": container with ID starting with 37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8 not found: ID does not exist" containerID="37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8"
Sep 10 15:04:53.092165 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.092121    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8"} err="failed to get container status \"37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8\": rpc error: code = NotFound desc = could not find container \"37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8\": container with ID starting with 37bd120f013f0431d712dbda7c0e74d87559def5948039b6c372af4df1c47ed8 not found: ID does not exist"
Sep 10 15:04:53.153308 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.153273    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"]
Sep 10 15:04:53.162305 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.162274    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e6941c-7c85bd4db6-rwmpr"]
Sep 10 15:04:53.181278 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.181241    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"]
Sep 10 15:04:53.188087 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.188053    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e6941c-6956c645d9-28klk"]
Sep 10 15:04:53.994681 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.994638    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279e395a-e7a4-40b3-a45d-7f841df6c6df" path="/var/lib/kubelet/pods/279e395a-e7a4-40b3-a45d-7f841df6c6df/volumes"
Sep 10 15:04:53.995128 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.995081    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="691545f2-d651-426f-beb4-2da71de50eff" path="/var/lib/kubelet/pods/691545f2-d651-426f-beb4-2da71de50eff/volumes"
Sep 10 15:04:53.995383 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.995369    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0f79c28-5394-42c3-beac-141f0a1ed807" path="/var/lib/kubelet/pods/a0f79c28-5394-42c3-beac-141f0a1ed807/volumes"
Sep 10 15:04:53.995628 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:04:53.995615    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a388f912-7e3b-4470-a202-993fff585d86" path="/var/lib/kubelet/pods/a388f912-7e3b-4470-a202-993fff585d86/volumes"
Sep 10 15:05:01.808177 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:01.808141    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"]
Sep 10 15:05:01.808773 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:01.808422    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy" containerID="cri-o://7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244" gracePeriod=30
Sep 10 15:05:07.076309 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.076272    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 15:05:07.081456 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081410    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-credential-socket\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081456 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081457    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-socket\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081698 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081517    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-token\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081698 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081569    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-certs\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081698 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081598    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-kube-api-access-8tkcc\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081698 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081664    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istiod-ca-cert\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081947 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081695    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-podinfo\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081947 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081755    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:05:07.081947 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081769    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-envoy\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081947 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-data\") pod \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\" (UID: \"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54\") "
Sep 10 15:05:07.081947 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.081836    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:05:07.082251 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.082152    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:05:07.082251 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.082239    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.082366 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.082261    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.082366 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.082275    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.082482 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.082390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:05:07.082482 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.082432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:05:07.084171 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.084145    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:05:07.084604 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.084580    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:05:07.084675 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.084589    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-kube-api-access-8tkcc" (OuterVolumeSpecName: "kube-api-access-8tkcc") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "kube-api-access-8tkcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:05:07.084738 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.084691    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" (UID: "2d704cb4-fdf6-4135-bf6c-3eb1aa723f54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:05:07.146939 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.146903    2561 scope.go:117] "RemoveContainer" containerID="9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"
Sep 10 15:05:07.158348 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.158306    2561 generic.go:356] "Generic (PLEG): container finished" podID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerID="7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244" exitCode=0
Sep 10 15:05:07.158348 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.158327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" event={"ID":"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54","Type":"ContainerDied","Data":"7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"}
Sep 10 15:05:07.158594 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.158373    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"
Sep 10 15:05:07.158594 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.158385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795" event={"ID":"2d704cb4-fdf6-4135-bf6c-3eb1aa723f54","Type":"ContainerDied","Data":"d601150338c6cb754af0141c478774e6851d0e8d5f5edbe45ef3a9b53c6adbf0"}
Sep 10 15:05:07.158594 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.158417    2561 scope.go:117] "RemoveContainer" containerID="7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"
Sep 10 15:05:07.159566 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.159544    2561 scope.go:117] "RemoveContainer" containerID="7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"
Sep 10 15:05:07.171629 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:05:07.171595    2561 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_istio-proxy_e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795_openshift-ingress_2d704cb4-fdf6-4135-bf6c-3eb1aa723f54_1 in pod sandbox d601150338c6cb754af0141c478774e6851d0e8d5f5edbe45ef3a9b53c6adbf0 from index: no such id: '7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244'" containerID="7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"
Sep 10 15:05:07.171762 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.171644    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"} err="rpc error: code = Unknown desc = failed to delete container k8s_istio-proxy_e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795_openshift-ingress_2d704cb4-fdf6-4135-bf6c-3eb1aa723f54_1 in pod sandbox d601150338c6cb754af0141c478774e6851d0e8d5f5edbe45ef3a9b53c6adbf0 from index: no such id: '7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244'"
Sep 10 15:05:07.171762 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.171669    2561 scope.go:117] "RemoveContainer" containerID="9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"
Sep 10 15:05:07.172060 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:05:07.172033    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6\": container with ID starting with 9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6 not found: ID does not exist" containerID="9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"
Sep 10 15:05:07.172122 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.172076    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"} err="failed to get container status \"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6\": rpc error: code = NotFound desc = could not find container \"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6\": container with ID starting with 9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6 not found: ID does not exist"
Sep 10 15:05:07.172122 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.172105    2561 scope.go:117] "RemoveContainer" containerID="7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"
Sep 10 15:05:07.172441 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:05:07.172422    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244\": container with ID starting with 7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244 not found: ID does not exist" containerID="7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"
Sep 10 15:05:07.172521 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.172453    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244"} err="failed to get container status \"7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244\": rpc error: code = NotFound desc = could not find container \"7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244\": container with ID starting with 7bcd08ef7b310417666d423221640a3c5971e6278cda5c05271741544584d244 not found: ID does not exist"
Sep 10 15:05:07.172521 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.172477    2561 scope.go:117] "RemoveContainer" containerID="9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"
Sep 10 15:05:07.172832 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.172808    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6"} err="failed to get container status \"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6\": rpc error: code = NotFound desc = could not find container \"9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6\": container with ID starting with 9744ffb47b4ac156164964828adf12a8d4b77833b5c6b16aa315655f3d315db6 not found: ID does not exist"
Sep 10 15:05:07.183274 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.183218    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.183274 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.183250    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.183274 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.183264    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.183396 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.183278    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.183396 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.183291    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.183396 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.183305    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tkcc\" (UniqueName: \"kubernetes.io/projected/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54-kube-api-access-8tkcc\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:05:07.207084 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.207055    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"]
Sep 10 15:05:07.229214 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.229178    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e6941c-openshift-default-5799fc866-tt795"]
Sep 10 15:05:07.994479 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:05:07.994444    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" path="/var/lib/kubelet/pods/2d704cb4-fdf6-4135-bf6c-3eb1aa723f54/volumes"
Sep 10 15:06:07.209229 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:06:07.209192    2561 scope.go:117] "RemoveContainer" containerID="b0eafe610120c2f3d962931fd4ce0878990e496f5b2643427c81f615b588303d"
Sep 10 15:07:43.107438 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.107398    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"]
Sep 10 15:07:43.110011 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.107607    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager" containerID="cri-o://99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a" gracePeriod=10
Sep 10 15:07:43.659479 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.659451    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 15:07:43.781314 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.781210    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbkbx\" (UniqueName: \"kubernetes.io/projected/187c4f77-1bd2-425e-a1aa-648dcc6e8713-kube-api-access-xbkbx\") pod \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") "
Sep 10 15:07:43.781314 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.781302    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/187c4f77-1bd2-425e-a1aa-648dcc6e8713-extensions-socket-volume\") pod \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\" (UID: \"187c4f77-1bd2-425e-a1aa-648dcc6e8713\") "
Sep 10 15:07:43.781654 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.781626    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/187c4f77-1bd2-425e-a1aa-648dcc6e8713-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "187c4f77-1bd2-425e-a1aa-648dcc6e8713" (UID: "187c4f77-1bd2-425e-a1aa-648dcc6e8713"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:07:43.783333 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.783307    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/187c4f77-1bd2-425e-a1aa-648dcc6e8713-kube-api-access-xbkbx" (OuterVolumeSpecName: "kube-api-access-xbkbx") pod "187c4f77-1bd2-425e-a1aa-648dcc6e8713" (UID: "187c4f77-1bd2-425e-a1aa-648dcc6e8713"). InnerVolumeSpecName "kube-api-access-xbkbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:07:43.882215 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.882172    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbkbx\" (UniqueName: \"kubernetes.io/projected/187c4f77-1bd2-425e-a1aa-648dcc6e8713-kube-api-access-xbkbx\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:07:43.882215 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:43.882202    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/187c4f77-1bd2-425e-a1aa-648dcc6e8713-extensions-socket-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:07:44.021507 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.021471    2561 generic.go:356] "Generic (PLEG): container finished" podID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerID="99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a" exitCode=0
Sep 10 15:07:44.021725 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.021531    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"
Sep 10 15:07:44.021725 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.021556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerDied","Data":"99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a"}
Sep 10 15:07:44.021725 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.021611    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx" event={"ID":"187c4f77-1bd2-425e-a1aa-648dcc6e8713","Type":"ContainerDied","Data":"27b0747045191af3ce093ad8923198aed973f4dbe9f8c36e312cfed754953669"}
Sep 10 15:07:44.021725 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.021635    2561 scope.go:117] "RemoveContainer" containerID="99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a"
Sep 10 15:07:44.031179 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.031159    2561 scope.go:117] "RemoveContainer" containerID="f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"
Sep 10 15:07:44.040095 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.040072    2561 scope.go:117] "RemoveContainer" containerID="99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a"
Sep 10 15:07:44.040443 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:07:44.040415    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a\": container with ID starting with 99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a not found: ID does not exist" containerID="99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a"
Sep 10 15:07:44.040519 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.040454    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a"} err="failed to get container status \"99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a\": rpc error: code = NotFound desc = could not find container \"99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a\": container with ID starting with 99296b452eb8c77a47cd218f61840dd98a164fa6011b60bb04e2b0240b6ab32a not found: ID does not exist"
Sep 10 15:07:44.040519 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.040475    2561 scope.go:117] "RemoveContainer" containerID="f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"
Sep 10 15:07:44.040793 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:07:44.040771    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b\": container with ID starting with f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b not found: ID does not exist" containerID="f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"
Sep 10 15:07:44.040847 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.040803    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b"} err="failed to get container status \"f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b\": rpc error: code = NotFound desc = could not find container \"f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b\": container with ID starting with f471d581f9d8b39b250c9e32cc1f6303a33bcb6aeaea8b130f16fc82da9c950b not found: ID does not exist"
Sep 10 15:07:44.040894 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.040886    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"]
Sep 10 15:07:44.045346 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:44.045319    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6ckfx"]
Sep 10 15:07:45.993530 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:07:45.993497    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" path="/var/lib/kubelet/pods/187c4f77-1bd2-425e-a1aa-648dcc6e8713/volumes"
Sep 10 15:08:43.845015 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.844929    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"]
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845403    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845418    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845428    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f79c28-5394-42c3-beac-141f0a1ed807" containerName="revoke-keys"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845434    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f79c28-5394-42c3-beac-141f0a1ed807" containerName="revoke-keys"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845442    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845447    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845457    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845463    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845483    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="691545f2-d651-426f-beb4-2da71de50eff" containerName="payload-processing"
Sep 10 15:08:43.845497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845490    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="691545f2-d651-426f-beb4-2da71de50eff" containerName="payload-processing"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845521    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845527    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845535    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845541    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845555    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279e395a-e7a4-40b3-a45d-7f841df6c6df" containerName="payload-pre-processing"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845565    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279e395a-e7a4-40b3-a45d-7f841df6c6df" containerName="payload-pre-processing"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845628    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="691545f2-d651-426f-beb4-2da71de50eff" containerName="payload-processing"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845640    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845649    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="812c077d-be48-4d3b-aa31-e10dda927a44" containerName="istio-proxy"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845656    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845662    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845668    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845677    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0f79c28-5394-42c3-beac-141f0a1ed807" containerName="revoke-keys"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845683    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy"
Sep 10 15:08:43.845833 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.845689    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="279e395a-e7a4-40b3-a45d-7f841df6c6df" containerName="payload-pre-processing"
Sep 10 15:08:43.848890 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.848870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:43.854224 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.854199    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kkwjv\""
Sep 10 15:08:43.893400 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.893364    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"]
Sep 10 15:08:43.896687 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.896665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jws5q\" (UniqueName: \"kubernetes.io/projected/8ee633f8-65c0-4a50-a987-49e2b9761481-kube-api-access-jws5q\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7ddcn\" (UID: \"8ee633f8-65c0-4a50-a987-49e2b9761481\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:43.896760 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.896699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee633f8-65c0-4a50-a987-49e2b9761481-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7ddcn\" (UID: \"8ee633f8-65c0-4a50-a987-49e2b9761481\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:43.997515 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.997478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jws5q\" (UniqueName: \"kubernetes.io/projected/8ee633f8-65c0-4a50-a987-49e2b9761481-kube-api-access-jws5q\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7ddcn\" (UID: \"8ee633f8-65c0-4a50-a987-49e2b9761481\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:43.997515 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.997517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee633f8-65c0-4a50-a987-49e2b9761481-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7ddcn\" (UID: \"8ee633f8-65c0-4a50-a987-49e2b9761481\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:43.997918 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:43.997900    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee633f8-65c0-4a50-a987-49e2b9761481-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7ddcn\" (UID: \"8ee633f8-65c0-4a50-a987-49e2b9761481\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:44.050855 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:44.050822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jws5q\" (UniqueName: \"kubernetes.io/projected/8ee633f8-65c0-4a50-a987-49e2b9761481-kube-api-access-jws5q\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7ddcn\" (UID: \"8ee633f8-65c0-4a50-a987-49e2b9761481\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:44.159482 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:44.159441    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:44.447836 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:44.447798    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"]
Sep 10 15:08:44.450276 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:08:44.450247    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee633f8_65c0_4a50_a987_49e2b9761481.slice/crio-d1053be0d13d2cbc9696ae89ec7b4d70d6e5a259f76ab4008b679338ac122f3b WatchSource:0}: Error finding container d1053be0d13d2cbc9696ae89ec7b4d70d6e5a259f76ab4008b679338ac122f3b: Status 404 returned error can't find the container with id d1053be0d13d2cbc9696ae89ec7b4d70d6e5a259f76ab4008b679338ac122f3b
Sep 10 15:08:45.357915 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:45.357881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn" event={"ID":"8ee633f8-65c0-4a50-a987-49e2b9761481","Type":"ContainerStarted","Data":"76aaa02f7690bbd1df9f5cbd6317f48e1db567e1273dfe6b8fa9a65224418380"}
Sep 10 15:08:45.358329 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:45.357937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn" event={"ID":"8ee633f8-65c0-4a50-a987-49e2b9761481","Type":"ContainerStarted","Data":"d1053be0d13d2cbc9696ae89ec7b4d70d6e5a259f76ab4008b679338ac122f3b"}
Sep 10 15:08:45.358329 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:45.358005    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:08:45.405003 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:45.404943    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn" podStartSLOduration=2.40492472 podStartE2EDuration="2.40492472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:08:45.399961501 +0000 UTC m=+2439.864328022" watchObservedRunningTime="2026-09-10 15:08:45.40492472 +0000 UTC m=+2439.869291241"
Sep 10 15:08:56.372334 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:08:56.372300    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7ddcn"
Sep 10 15:09:07.253530 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:07.253494    2561 scope.go:117] "RemoveContainer" containerID="0aa72f6c31a239ba917a4fa9d1a737443be75bd0952e9c3243f05c4bd91f3e9f"
Sep 10 15:09:07.262508 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:07.262484    2561 scope.go:117] "RemoveContainer" containerID="fb4d371407ff723dfcf68fa5bdafa575d4253cf7e7ab50ef38163c841662e875"
Sep 10 15:09:43.840475 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.840442    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"]
Sep 10 15:09:43.840979 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.840915    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy"
Sep 10 15:09:43.840979 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.840929    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy"
Sep 10 15:09:43.840979 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.840940    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy"
Sep 10 15:09:43.840979 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.840945    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50a5aba-62b6-413f-8541-5d4699636507" containerName="istio-proxy"
Sep 10 15:09:43.841116 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.841027    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="187c4f77-1bd2-425e-a1aa-648dcc6e8713" containerName="manager"
Sep 10 15:09:43.841116 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.841034    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d704cb4-fdf6-4135-bf6c-3eb1aa723f54" containerName="istio-proxy"
Sep 10 15:09:43.844064 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.844042    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:43.846808 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.846786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ac593d41-kserve-self-signed-certs\""
Sep 10 15:09:43.857501 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.857478    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"]
Sep 10 15:09:43.909425 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.909376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f6202c-a957-417b-a78c-ed723b23eaab-tls-certs\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:43.909620 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.909437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-home\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:43.909620 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.909468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-dshm\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:43.909620 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.909496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbmz7\" (UniqueName: \"kubernetes.io/projected/c8f6202c-a957-417b-a78c-ed723b23eaab-kube-api-access-mbmz7\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:43.909620 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.909564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-model-cache\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:43.909826 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:43.909751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-tmp-dir\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.010933 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.010893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-tmp-dir\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011194 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f6202c-a957-417b-a78c-ed723b23eaab-tls-certs\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011194 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-home\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011325 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-dshm\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011325 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbmz7\" (UniqueName: \"kubernetes.io/projected/c8f6202c-a957-417b-a78c-ed723b23eaab-kube-api-access-mbmz7\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011325 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-model-cache\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011486 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-tmp-dir\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011486 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-home\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.011661 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.011641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-model-cache\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.013666 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.013642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-dshm\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.013822 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.013678    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f6202c-a957-417b-a78c-ed723b23eaab-tls-certs\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.020358 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.020324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbmz7\" (UniqueName: \"kubernetes.io/projected/c8f6202c-a957-417b-a78c-ed723b23eaab-kube-api-access-mbmz7\") pod \"e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") " pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.153582 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.153542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:44.428391 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.428363    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"]
Sep 10 15:09:44.431131 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:09:44.431086    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8f6202c_a957_417b_a78c_ed723b23eaab.slice/crio-9ae12880f7949ab3d2ce08a5990f4ea3360b90e0dda44919beddf2230d8bc5c6 WatchSource:0}: Error finding container 9ae12880f7949ab3d2ce08a5990f4ea3360b90e0dda44919beddf2230d8bc5c6: Status 404 returned error can't find the container with id 9ae12880f7949ab3d2ce08a5990f4ea3360b90e0dda44919beddf2230d8bc5c6
Sep 10 15:09:44.690941 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.690836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v" event={"ID":"c8f6202c-a957-417b-a78c-ed723b23eaab","Type":"ContainerStarted","Data":"6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506"}
Sep 10 15:09:44.690941 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.690881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v" event={"ID":"c8f6202c-a957-417b-a78c-ed723b23eaab","Type":"ContainerStarted","Data":"9ae12880f7949ab3d2ce08a5990f4ea3360b90e0dda44919beddf2230d8bc5c6"}
Sep 10 15:09:44.710928 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:44.710864    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v" podStartSLOduration=1.710843019 podStartE2EDuration="1.710843019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:09:44.709162423 +0000 UTC m=+2499.173528962" watchObservedRunningTime="2026-09-10 15:09:44.710843019 +0000 UTC m=+2499.175209541"
Sep 10 15:09:54.154503 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:54.154464    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:54.154503 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:54.154517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:54.167344 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:54.167317    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:09:54.760728 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:09:54.760675    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:10:07.287154 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:07.287075    2561 scope.go:117] "RemoveContainer" containerID="12ad1754268706189deecbd42f9a8efcd048ded7d2af38ff2d51c5337b26f37d"
Sep 10 15:10:17.253056 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:17.253021    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"]
Sep 10 15:10:32.273354 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.273303    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v" podUID="c8f6202c-a957-417b-a78c-ed723b23eaab" containerName="main" containerID="cri-o://6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506" gracePeriod=45
Sep 10 15:10:32.528951 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.528871    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:10:32.590855 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.590809    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbmz7\" (UniqueName: \"kubernetes.io/projected/c8f6202c-a957-417b-a78c-ed723b23eaab-kube-api-access-mbmz7\") pod \"c8f6202c-a957-417b-a78c-ed723b23eaab\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") "
Sep 10 15:10:32.591056 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.590901    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-tmp-dir\") pod \"c8f6202c-a957-417b-a78c-ed723b23eaab\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") "
Sep 10 15:10:32.591056 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.590952    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-dshm\") pod \"c8f6202c-a957-417b-a78c-ed723b23eaab\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") "
Sep 10 15:10:32.591056 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.590972    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-home\") pod \"c8f6202c-a957-417b-a78c-ed723b23eaab\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") "
Sep 10 15:10:32.591056 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591003    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-model-cache\") pod \"c8f6202c-a957-417b-a78c-ed723b23eaab\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") "
Sep 10 15:10:32.591292 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591087    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f6202c-a957-417b-a78c-ed723b23eaab-tls-certs\") pod \"c8f6202c-a957-417b-a78c-ed723b23eaab\" (UID: \"c8f6202c-a957-417b-a78c-ed723b23eaab\") "
Sep 10 15:10:32.591292 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591198    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c8f6202c-a957-417b-a78c-ed723b23eaab" (UID: "c8f6202c-a957-417b-a78c-ed723b23eaab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:10:32.591414 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591316    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-home" (OuterVolumeSpecName: "home") pod "c8f6202c-a957-417b-a78c-ed723b23eaab" (UID: "c8f6202c-a957-417b-a78c-ed723b23eaab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:10:32.591414 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591382    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-model-cache" (OuterVolumeSpecName: "model-cache") pod "c8f6202c-a957-417b-a78c-ed723b23eaab" (UID: "c8f6202c-a957-417b-a78c-ed723b23eaab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:10:32.591533 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591512    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-tmp-dir\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:10:32.591576 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591539    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-home\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:10:32.591576 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.591555    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-model-cache\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:10:32.593210 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.593188    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f6202c-a957-417b-a78c-ed723b23eaab-kube-api-access-mbmz7" (OuterVolumeSpecName: "kube-api-access-mbmz7") pod "c8f6202c-a957-417b-a78c-ed723b23eaab" (UID: "c8f6202c-a957-417b-a78c-ed723b23eaab"). InnerVolumeSpecName "kube-api-access-mbmz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:10:32.593285 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.593211    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8f6202c-a957-417b-a78c-ed723b23eaab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c8f6202c-a957-417b-a78c-ed723b23eaab" (UID: "c8f6202c-a957-417b-a78c-ed723b23eaab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:10:32.593323 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.593290    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-dshm" (OuterVolumeSpecName: "dshm") pod "c8f6202c-a957-417b-a78c-ed723b23eaab" (UID: "c8f6202c-a957-417b-a78c-ed723b23eaab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:10:32.692694 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.692658    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f6202c-a957-417b-a78c-ed723b23eaab-tls-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:10:32.692694 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.692690    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbmz7\" (UniqueName: \"kubernetes.io/projected/c8f6202c-a957-417b-a78c-ed723b23eaab-kube-api-access-mbmz7\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:10:32.692694 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.692700    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f6202c-a957-417b-a78c-ed723b23eaab-dshm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Sep 10 15:10:32.960807 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.960771    2561 generic.go:356] "Generic (PLEG): container finished" podID="c8f6202c-a957-417b-a78c-ed723b23eaab" containerID="6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506" exitCode=0
Sep 10 15:10:32.960995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.960814    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"
Sep 10 15:10:32.960995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.960865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v" event={"ID":"c8f6202c-a957-417b-a78c-ed723b23eaab","Type":"ContainerDied","Data":"6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506"}
Sep 10 15:10:32.960995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.960911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v" event={"ID":"c8f6202c-a957-417b-a78c-ed723b23eaab","Type":"ContainerDied","Data":"9ae12880f7949ab3d2ce08a5990f4ea3360b90e0dda44919beddf2230d8bc5c6"}
Sep 10 15:10:32.960995 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.960929    2561 scope.go:117] "RemoveContainer" containerID="6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506"
Sep 10 15:10:32.970548 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.970531    2561 scope.go:117] "RemoveContainer" containerID="6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506"
Sep 10 15:10:32.970881 ip-10-0-137-62 kubenswrapper[2561]: E0910 15:10:32.970860    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506\": container with ID starting with 6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506 not found: ID does not exist" containerID="6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506"
Sep 10 15:10:32.970969 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.970890    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506"} err="failed to get container status \"6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506\": rpc error: code = NotFound desc = could not find container \"6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506\": container with ID starting with 6037212a9104263cb28c1005ed3e2c9ace1f365600c9b9d54d03659b623c7506 not found: ID does not exist"
Sep 10 15:10:32.982896 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.982872    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"]
Sep 10 15:10:32.986511 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:32.986486    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ac593d41-kserve-58fd77f747-tg49v"]
Sep 10 15:10:33.994256 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:10:33.994222    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f6202c-a957-417b-a78c-ed723b23eaab" path="/var/lib/kubelet/pods/c8f6202c-a957-417b-a78c-ed723b23eaab/volumes"
Sep 10 15:11:07.308399 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:07.308363    2561 scope.go:117] "RemoveContainer" containerID="e27c7ff12297b1356dc39c6a30a5c7ff71dedf5e276abf74938567bffdcd19e4"
Sep 10 15:11:07.316987 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:07.316958    2561 scope.go:117] "RemoveContainer" containerID="605fc9e04e7159ce50aadc97e8c09424f1b58f36990c5f9fe79a6730288841b9"
Sep 10 15:11:11.766614 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:11.766573    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-677cc6cd44-ccq75_46f02395-dd8f-4612-9f25-54c70204b5fd/authorino/0.log"
Sep 10 15:11:17.430477 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:17.430437    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2vbkl_caffac9b-cab7-4939-9cc5-574d6de34ca4/manager/0.log"
Sep 10 15:11:17.835265 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:17.835171    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q7m4v_2286f2fb-ed55-42ca-b8e0-a4023f2c031c/server/0.log"
Sep 10 15:11:17.964250 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:17.964220    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m7492_91d2b052-edce-4aa1-a92a-b587de28f400/manager/0.log"
Sep 10 15:11:18.227424 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:18.227393    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dd699645-f425c_3cfb4c6b-b4f8-4349-9e29-2ec00451bca7/copy-manifests/0.log"
Sep 10 15:11:18.237861 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:18.237836    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dd699645-f425c_3cfb4c6b-b4f8-4349-9e29-2ec00451bca7/manager/0.log"
Sep 10 15:11:19.106360 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:19.106329    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817540-4qqqj_2cb819ab-6fc7-4d14-b3b5-3906433d9eac/cleanup/0.log"
Sep 10 15:11:19.226618 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:19.226590    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ln8m7_92cf3bbb-c861-483a-b256-5e9173241ff7/postgres/0.log"
Sep 10 15:11:20.033047 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:20.033012    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-677cc6cd44-ccq75_46f02395-dd8f-4612-9f25-54c70204b5fd/authorino/0.log"
Sep 10 15:11:20.537588 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:20.537555    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7ddcn_8ee633f8-65c0-4a50-a987-49e2b9761481/manager/0.log"
Sep 10 15:11:21.144336 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:21.144294    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7_be798e1b-8355-46f8-b39c-e84090351bdf/istio-proxy/0.log"
Sep 10 15:11:21.605195 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:21.605168    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8xwvv_fcc17185-b5aa-4811-a9ef-af638d47a375/istio-proxy/1.log"
Sep 10 15:11:22.313367 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:22.313329    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z8vqj_956eb6a5-07fd-4092-a9c5-3388193fff18/main/0.log"
Sep 10 15:11:22.544051 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:22.544011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-bz4hf_f0272b91-e109-46a2-8e25-305228bf4bd5/main/0.log"
Sep 10 15:11:22.770768 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:22.770739    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjkdmm_d5887ffb-712c-4199-9fe5-34e9040a41f0/main/0.log"
Sep 10 15:11:29.070185 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.070087    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fqt5c/must-gather-cvt57"]
Sep 10 15:11:29.070772 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.070751    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f6202c-a957-417b-a78c-ed723b23eaab" containerName="main"
Sep 10 15:11:29.070772 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.070773    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f6202c-a957-417b-a78c-ed723b23eaab" containerName="main"
Sep 10 15:11:29.070929 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.070914    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f6202c-a957-417b-a78c-ed723b23eaab" containerName="main"
Sep 10 15:11:29.074125 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.074103    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.077493 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.077468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fqt5c\"/\"default-dockercfg-f4hgn\""
Sep 10 15:11:29.078742 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.078686    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fqt5c\"/\"kube-root-ca.crt\""
Sep 10 15:11:29.078742 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.078688    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fqt5c\"/\"openshift-service-ca.crt\""
Sep 10 15:11:29.089264 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.089234    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqt5c/must-gather-cvt57"]
Sep 10 15:11:29.177436 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.177403    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bswv\" (UniqueName: \"kubernetes.io/projected/b6457de6-6d04-487a-a08d-7b5813b183fe-kube-api-access-2bswv\") pod \"must-gather-cvt57\" (UID: \"b6457de6-6d04-487a-a08d-7b5813b183fe\") " pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.177617 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.177480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6457de6-6d04-487a-a08d-7b5813b183fe-must-gather-output\") pod \"must-gather-cvt57\" (UID: \"b6457de6-6d04-487a-a08d-7b5813b183fe\") " pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.278507 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.278469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bswv\" (UniqueName: \"kubernetes.io/projected/b6457de6-6d04-487a-a08d-7b5813b183fe-kube-api-access-2bswv\") pod \"must-gather-cvt57\" (UID: \"b6457de6-6d04-487a-a08d-7b5813b183fe\") " pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.278733 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.278549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6457de6-6d04-487a-a08d-7b5813b183fe-must-gather-output\") pod \"must-gather-cvt57\" (UID: \"b6457de6-6d04-487a-a08d-7b5813b183fe\") " pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.278964 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.278941    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6457de6-6d04-487a-a08d-7b5813b183fe-must-gather-output\") pod \"must-gather-cvt57\" (UID: \"b6457de6-6d04-487a-a08d-7b5813b183fe\") " pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.287939 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.287915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bswv\" (UniqueName: \"kubernetes.io/projected/b6457de6-6d04-487a-a08d-7b5813b183fe-kube-api-access-2bswv\") pod \"must-gather-cvt57\" (UID: \"b6457de6-6d04-487a-a08d-7b5813b183fe\") " pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.384409 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.384308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqt5c/must-gather-cvt57"
Sep 10 15:11:29.662402 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.662374    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqt5c/must-gather-cvt57"]
Sep 10 15:11:29.663511 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:11:29.663487    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6457de6_6d04_487a_a08d_7b5813b183fe.slice/crio-8b868259c72a15e8c92acdaa77fcc6b6d200eafb4dc2dd326f84029689c3fba8 WatchSource:0}: Error finding container 8b868259c72a15e8c92acdaa77fcc6b6d200eafb4dc2dd326f84029689c3fba8: Status 404 returned error can't find the container with id 8b868259c72a15e8c92acdaa77fcc6b6d200eafb4dc2dd326f84029689c3fba8
Sep 10 15:11:29.665498 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:29.665480    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:11:30.266501 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:30.266464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqt5c/must-gather-cvt57" event={"ID":"b6457de6-6d04-487a-a08d-7b5813b183fe","Type":"ContainerStarted","Data":"8b868259c72a15e8c92acdaa77fcc6b6d200eafb4dc2dd326f84029689c3fba8"}
Sep 10 15:11:31.276301 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:31.276247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqt5c/must-gather-cvt57" event={"ID":"b6457de6-6d04-487a-a08d-7b5813b183fe","Type":"ContainerStarted","Data":"f82a016cf46ee0f1fad9a9ba80cdcc15dcaa47d058ebf5b47fff9279172156bd"}
Sep 10 15:11:31.276825 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:31.276321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqt5c/must-gather-cvt57" event={"ID":"b6457de6-6d04-487a-a08d-7b5813b183fe","Type":"ContainerStarted","Data":"389d35496c8e9e54627feca57435a35e23a8b93b424a4cb67862192356d6458d"}
Sep 10 15:11:31.296310 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:31.296252    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fqt5c/must-gather-cvt57" podStartSLOduration=1.396262611 podStartE2EDuration="2.296235144s" totalImagesPullingTime="899.972533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:11:31.29319994 +0000 UTC m=+2605.757566463" watchObservedRunningTime="2026-09-10 15:11:31.296235144 +0000 UTC m=+2605.760601665"
Sep 10 15:11:32.139879 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:32.139845    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8l7m8_a2302ed9-18a1-4e02-913d-ff52ce1e809a/global-pull-secret-syncer/0.log"
Sep 10 15:11:32.310650 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:32.310619    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7bbgl_4a241bd0-29b2-4619-9b3b-e0cf15f5bc80/konnectivity-agent/0.log"
Sep 10 15:11:32.412461 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:32.412423    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-62.ec2.internal_b2c7e12d74c055eb868a423b92fc23f4/haproxy/0.log"
Sep 10 15:11:37.520728 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:37.519032    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-677cc6cd44-ccq75_46f02395-dd8f-4612-9f25-54c70204b5fd/authorino/0.log"
Sep 10 15:11:37.659456 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:37.659409    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7ddcn_8ee633f8-65c0-4a50-a987-49e2b9761481/manager/0.log"
Sep 10 15:11:39.496330 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.496200    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bc3cdb-b0cf-4d68-a695-ea78612e18b2/alertmanager/0.log"
Sep 10 15:11:39.522831 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.522795    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bc3cdb-b0cf-4d68-a695-ea78612e18b2/config-reloader/0.log"
Sep 10 15:11:39.556365 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.556327    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bc3cdb-b0cf-4d68-a695-ea78612e18b2/kube-rbac-proxy-web/0.log"
Sep 10 15:11:39.585101 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.585066    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bc3cdb-b0cf-4d68-a695-ea78612e18b2/kube-rbac-proxy/0.log"
Sep 10 15:11:39.630029 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.629971    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bc3cdb-b0cf-4d68-a695-ea78612e18b2/kube-rbac-proxy-metric/0.log"
Sep 10 15:11:39.657484 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.657305    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bc3cdb-b0cf-4d68-a695-ea78612e18b2/prom-label-proxy/0.log"
Sep 10 15:11:39.698496 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.698430    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48bc3cdb-b0cf-4d68-a695-ea78612e18b2/init-config-reloader/0.log"
Sep 10 15:11:39.850857 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.850831    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d6895bcbc-9qjcq_0d94a3f8-b314-4365-b8ff-111b1cadc29e/metrics-server/0.log"
Sep 10 15:11:39.886014 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.885949    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-n2s6r_543e1c27-bc2d-476a-bfea-514ada4c0db9/monitoring-plugin/0.log"
Sep 10 15:11:39.919749 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.919660    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ls7vq_98c0ac1e-7335-477d-a699-e7adac5024de/node-exporter/0.log"
Sep 10 15:11:39.944773 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.944747    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ls7vq_98c0ac1e-7335-477d-a699-e7adac5024de/kube-rbac-proxy/0.log"
Sep 10 15:11:39.967161 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:39.967134    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ls7vq_98c0ac1e-7335-477d-a699-e7adac5024de/init-textfile/0.log"
Sep 10 15:11:40.166007 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.165975    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-8kn76_859d2323-78bd-48b4-9efb-b0449ecd17ce/kube-rbac-proxy-main/0.log"
Sep 10 15:11:40.192192 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.192095    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-8kn76_859d2323-78bd-48b4-9efb-b0449ecd17ce/kube-rbac-proxy-self/0.log"
Sep 10 15:11:40.217409 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.217360    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-8kn76_859d2323-78bd-48b4-9efb-b0449ecd17ce/openshift-state-metrics/0.log"
Sep 10 15:11:40.256372 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.256328    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee2fd6fd-2270-4c35-8da3-2e590ddf4a32/prometheus/0.log"
Sep 10 15:11:40.282415 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.282386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee2fd6fd-2270-4c35-8da3-2e590ddf4a32/config-reloader/0.log"
Sep 10 15:11:40.308659 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.308626    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee2fd6fd-2270-4c35-8da3-2e590ddf4a32/thanos-sidecar/0.log"
Sep 10 15:11:40.342371 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.342340    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee2fd6fd-2270-4c35-8da3-2e590ddf4a32/kube-rbac-proxy-web/0.log"
Sep 10 15:11:40.365682 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.365655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee2fd6fd-2270-4c35-8da3-2e590ddf4a32/kube-rbac-proxy/0.log"
Sep 10 15:11:40.390380 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.390349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee2fd6fd-2270-4c35-8da3-2e590ddf4a32/kube-rbac-proxy-thanos/0.log"
Sep 10 15:11:40.412251 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.412215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee2fd6fd-2270-4c35-8da3-2e590ddf4a32/init-config-reloader/0.log"
Sep 10 15:11:40.449030 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.448944    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-xsjt7_da629d35-2a00-471a-a15d-f6c786815341/prometheus-operator/0.log"
Sep 10 15:11:40.473490 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.473456    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-xsjt7_da629d35-2a00-471a-a15d-f6c786815341/kube-rbac-proxy/0.log"
Sep 10 15:11:40.499497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.499463    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-gbp49_48ea2495-a5f9-4b92-a206-5bf4f1861794/prometheus-operator-admission-webhook/0.log"
Sep 10 15:11:40.543595 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.543555    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9cc97b99-4fpx4_c78c6286-de06-4ee1-94fd-49ad8b251fcb/telemeter-client/0.log"
Sep 10 15:11:40.584497 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.584471    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9cc97b99-4fpx4_c78c6286-de06-4ee1-94fd-49ad8b251fcb/reload/0.log"
Sep 10 15:11:40.620861 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.620828    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9cc97b99-4fpx4_c78c6286-de06-4ee1-94fd-49ad8b251fcb/kube-rbac-proxy/0.log"
Sep 10 15:11:40.653272 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.653105    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c875498bf-sqjkk_aac20b8f-c737-4a0d-904a-86c9f35c1b3d/thanos-query/0.log"
Sep 10 15:11:40.678452 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.678420    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c875498bf-sqjkk_aac20b8f-c737-4a0d-904a-86c9f35c1b3d/kube-rbac-proxy-web/0.log"
Sep 10 15:11:40.700265 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.700171    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c875498bf-sqjkk_aac20b8f-c737-4a0d-904a-86c9f35c1b3d/kube-rbac-proxy/0.log"
Sep 10 15:11:40.721848 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.721816    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c875498bf-sqjkk_aac20b8f-c737-4a0d-904a-86c9f35c1b3d/prom-label-proxy/0.log"
Sep 10 15:11:40.743163 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.743131    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c875498bf-sqjkk_aac20b8f-c737-4a0d-904a-86c9f35c1b3d/kube-rbac-proxy-rules/0.log"
Sep 10 15:11:40.766556 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:40.766524    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c875498bf-sqjkk_aac20b8f-c737-4a0d-904a-86c9f35c1b3d/kube-rbac-proxy-metrics/0.log"
Sep 10 15:11:42.147021 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.146978    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-nwhvv_d9bec94c-eca2-4d41-bff0-7a1bf2abb439/networking-console-plugin/0.log"
Sep 10 15:11:42.825300 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.825257    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"]
Sep 10 15:11:42.834088 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.834048    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:42.839281 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.839242    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"]
Sep 10 15:11:42.979350 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.979305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-podres\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:42.979558 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.979430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dflm2\" (UniqueName: \"kubernetes.io/projected/b12712c5-1ec0-426a-a1ed-be042a4af1f9-kube-api-access-dflm2\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:42.979558 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.979552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-sys\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:42.979675 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.979573    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-proc\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:42.979675 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:42.979588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-lib-modules\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081238 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-sys\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081238 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-proc\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081238 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081234    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-proc\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081780 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-lib-modules\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081780 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-sys\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081780 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-podres\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081780 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-lib-modules\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081780 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b12712c5-1ec0-426a-a1ed-be042a4af1f9-podres\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.081780 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.081474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dflm2\" (UniqueName: \"kubernetes.io/projected/b12712c5-1ec0-426a-a1ed-be042a4af1f9-kube-api-access-dflm2\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.090441 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.090407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dflm2\" (UniqueName: \"kubernetes.io/projected/b12712c5-1ec0-426a-a1ed-be042a4af1f9-kube-api-access-dflm2\") pod \"perf-node-gather-daemonset-5jjrm\" (UID: \"b12712c5-1ec0-426a-a1ed-be042a4af1f9\") " pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.150048 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.150012    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:43.418800 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.418766    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-857558d647-qrhbn_ecd0f9dd-0a5f-42eb-924d-2a80a9ed1c9c/console/0.log"
Sep 10 15:11:43.451719 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.451673    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"]
Sep 10 15:11:43.453537 ip-10-0-137-62 kubenswrapper[2561]: W0910 15:11:43.453503    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb12712c5_1ec0_426a_a1ed_be042a4af1f9.slice/crio-2f4f40cf3b1bff559476a490c314ca21b5c05c33209291b57dab8ced559a73b7 WatchSource:0}: Error finding container 2f4f40cf3b1bff559476a490c314ca21b5c05c33209291b57dab8ced559a73b7: Status 404 returned error can't find the container with id 2f4f40cf3b1bff559476a490c314ca21b5c05c33209291b57dab8ced559a73b7
Sep 10 15:11:43.465288 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:43.465123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-sjzgm_d6503583-fa96-4abf-8358-e111d26dd240/download-server/0.log"
Sep 10 15:11:44.378761 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:44.378689    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm" event={"ID":"b12712c5-1ec0-426a-a1ed-be042a4af1f9","Type":"ContainerStarted","Data":"9f7641e794ff3f693ae7f31a0e27a2b47a241526aeb559e8bbcfd739b87a4955"}
Sep 10 15:11:44.379329 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:44.379302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm" event={"ID":"b12712c5-1ec0-426a-a1ed-be042a4af1f9","Type":"ContainerStarted","Data":"2f4f40cf3b1bff559476a490c314ca21b5c05c33209291b57dab8ced559a73b7"}
Sep 10 15:11:44.379462 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:44.379448    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:44.405141 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:44.405068    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm" podStartSLOduration=2.405045023 podStartE2EDuration="2.405045023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:11:44.401774723 +0000 UTC m=+2618.866141358" watchObservedRunningTime="2026-09-10 15:11:44.405045023 +0000 UTC m=+2618.869411550"
Sep 10 15:11:45.394367 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:45.394325    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftbx7_d6207832-42db-4634-b766-5ac799985fee/dns/0.log"
Sep 10 15:11:45.413723 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:45.413675    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftbx7_d6207832-42db-4634-b766-5ac799985fee/kube-rbac-proxy/0.log"
Sep 10 15:11:45.436504 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:45.436469    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lkcmg_06815116-8ee8-46d9-bec0-0d14f714e090/dns-node-resolver/0.log"
Sep 10 15:11:46.004283 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:46.004229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56678d7b8d-wr98f_12a3e115-7e26-4bdd-b077-c71259f6dd57/registry/0.log"
Sep 10 15:11:46.025736 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:46.025691    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dxkvg_4abca780-21a2-427b-88de-fd7860f80cc6/node-ca/0.log"
Sep 10 15:11:46.995583 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:46.995552    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7_be798e1b-8355-46f8-b39c-e84090351bdf/istio-proxy/0.log"
Sep 10 15:11:47.389774 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:47.389661    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8xwvv_fcc17185-b5aa-4811-a9ef-af638d47a375/istio-proxy/0.log"
Sep 10 15:11:47.393328 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:47.393100    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8xwvv_fcc17185-b5aa-4811-a9ef-af638d47a375/istio-proxy/1.log"
Sep 10 15:11:48.580001 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:48.579971    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zkx2k_1e60d686-fbc7-496e-b416-f440fbbd8e17/serve-healthcheck-canary/0.log"
Sep 10 15:11:49.245042 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:49.245005    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z99pd_a4828db3-d66a-4eb1-9350-645e57de1864/kube-rbac-proxy/0.log"
Sep 10 15:11:49.265410 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:49.265376    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z99pd_a4828db3-d66a-4eb1-9350-645e57de1864/exporter/0.log"
Sep 10 15:11:49.287027 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:49.286997    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z99pd_a4828db3-d66a-4eb1-9350-645e57de1864/extractor/0.log"
Sep 10 15:11:51.397003 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:51.396944    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2vbkl_caffac9b-cab7-4939-9cc5-574d6de34ca4/manager/0.log"
Sep 10 15:11:51.404869 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:51.404836    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fqt5c/perf-node-gather-daemonset-5jjrm"
Sep 10 15:11:51.784993 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:51.784887    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q7m4v_2286f2fb-ed55-42ca-b8e0-a4023f2c031c/server/0.log"
Sep 10 15:11:51.896907 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:51.896869    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m7492_91d2b052-edce-4aa1-a92a-b587de28f400/manager/0.log"
Sep 10 15:11:51.983304 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:51.983273    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dd699645-f425c_3cfb4c6b-b4f8-4349-9e29-2ec00451bca7/manager/0.log"
Sep 10 15:11:52.012221 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:52.012196    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dd699645-f425c_3cfb4c6b-b4f8-4349-9e29-2ec00451bca7/copy-manifests/0.log"
Sep 10 15:11:53.547615 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:53.547584    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7_be798e1b-8355-46f8-b39c-e84090351bdf/istio-proxy/0.log"
Sep 10 15:11:53.657325 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:53.657271    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c4b8b8b58-pmspv_db5654ef-b33d-4cb5-9045-c016ce20ddd8/manager/0.log"
Sep 10 15:11:53.888388 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:53.888268    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8xwvv_fcc17185-b5aa-4811-a9ef-af638d47a375/istio-proxy/0.log"
Sep 10 15:11:53.893107 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:53.893073    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8xwvv_fcc17185-b5aa-4811-a9ef-af638d47a375/istio-proxy/1.log"
Sep 10 15:11:55.518264 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:55.518234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rqrj7_be798e1b-8355-46f8-b39c-e84090351bdf/istio-proxy/0.log"
Sep 10 15:11:55.872280 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:55.872204    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8xwvv_fcc17185-b5aa-4811-a9ef-af638d47a375/istio-proxy/0.log"
Sep 10 15:11:55.875594 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:11:55.875555    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8xwvv_fcc17185-b5aa-4811-a9ef-af638d47a375/istio-proxy/1.log"
Sep 10 15:12:00.445412 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.445376    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8k6mr_170e4494-461c-449c-9566-264229206c49/kube-multus/0.log"
Sep 10 15:12:00.788818 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.788722    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5t6h_92c4d9ff-163b-4310-841a-2657d78f963b/kube-multus-additional-cni-plugins/0.log"
Sep 10 15:12:00.810753 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.810725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5t6h_92c4d9ff-163b-4310-841a-2657d78f963b/egress-router-binary-copy/0.log"
Sep 10 15:12:00.831223 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.831193    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5t6h_92c4d9ff-163b-4310-841a-2657d78f963b/cni-plugins/0.log"
Sep 10 15:12:00.852370 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.852339    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5t6h_92c4d9ff-163b-4310-841a-2657d78f963b/bond-cni-plugin/0.log"
Sep 10 15:12:00.873267 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.873234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5t6h_92c4d9ff-163b-4310-841a-2657d78f963b/routeoverride-cni/0.log"
Sep 10 15:12:00.897127 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.897098    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5t6h_92c4d9ff-163b-4310-841a-2657d78f963b/whereabouts-cni-bincopy/0.log"
Sep 10 15:12:00.920049 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:00.920017    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5t6h_92c4d9ff-163b-4310-841a-2657d78f963b/whereabouts-cni/0.log"
Sep 10 15:12:01.073979 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:01.073889    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6sq6k_d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac/network-metrics-daemon/0.log"
Sep 10 15:12:01.104849 ip-10-0-137-62 kubenswrapper[2561]: I0910 15:12:01.104820    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6sq6k_d0c0ca54-7b5c-498c-ad17-6ddd2a7107ac/kube-rbac-proxy/0.log"