Sep 11 12:45:10.815595 ip-10-0-136-247 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 12:45:10.815610 ip-10-0-136-247 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 12:45:10.815620 ip-10-0-136-247 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 12:45:10.815950 ip-10-0-136-247 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 12:45:20.991910 ip-10-0-136-247 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 12:45:20.991929 ip-10-0-136-247 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7904c0347612458d8aba327116f75d4e --
Sep 11 12:47:15.522635 ip-10-0-136-247 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 12:47:15.905528 ip-10-0-136-247 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:47:15.905528 ip-10-0-136-247 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 12:47:15.905528 ip-10-0-136-247 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:47:15.905528 ip-10-0-136-247 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 12:47:15.905528 ip-10-0-136-247 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:47:15.906196 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.905589    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 12:47:15.910979 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.910958    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:15.910979 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.910977    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:15.910979 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.910980    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:15.910979 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.910984    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:15.910979 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.910987    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.910992    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.910997    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911001    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911004    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911007    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911011    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911013    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911016    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911019    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911022    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911025    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911027    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911053    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911056    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911059    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911062    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911065    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911068    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:15.911177 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911071    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911074    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911076    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911079    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911082    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911085    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911087    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911090    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911097    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911100    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911102    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911105    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911108    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911112    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911115    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911118    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911121    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911124    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911127    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911129    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:15.911638 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911132    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911134    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911137    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911139    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911141    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911145    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911149    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911151    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911154    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911157    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911160    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911163    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911166    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911169    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911171    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911174    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911177    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911179    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911182    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911186    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:15.912165 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911190    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911193    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911195    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911198    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911200    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911203    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911206    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911209    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911211    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911214    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911217    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911219    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911222    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911224    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911227    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911229    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911231    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911234    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911236    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:15.912681 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911239    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911242    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911245    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911247    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911249    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911252    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911254    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911257    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911260    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911262    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911265    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911267    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911270    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911272    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911275    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911278    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.911280    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912874    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912883    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:15.913136 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912887    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912891    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912894    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912897    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912899    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912902    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912904    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912907    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912909    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912912    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912914    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912916    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912919    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912921    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912924    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912932    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912934    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912937    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912939    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912942    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:15.913610 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912945    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912948    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912950    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912954    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912958    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912961    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912964    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912967    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912969    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912972    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912975    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912978    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912980    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912983    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912985    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912988    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912990    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912992    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912995    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:15.914096 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.912998    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913001    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913004    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913007    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913009    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913012    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913014    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913016    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913019    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913022    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913024    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913027    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913029    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913032    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913035    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913037    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913040    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913042    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913045    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913048    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:15.914603 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913050    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913053    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913055    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913057    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913060    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913062    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913065    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913068    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913070    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913072    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913075    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913077    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913082    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913086    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913088    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913091    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913094    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913097    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913099    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:15.915186 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913102    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913105    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913107    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913110    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913114    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913116    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913119    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913121    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913124    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913126    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913129    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913131    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913134    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913136    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913139    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913141    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913144    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913146    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913149    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913534    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:15.915678 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913539    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913542    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913545    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913547    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913549    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913555    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913558    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913561    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913563    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913566    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913568    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913571    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913575    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913579    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913582    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913586    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913589    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913592    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913595    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913598    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:15.916163 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913601    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913604    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913606    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913610    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913612    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913615    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913618    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913620    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913623    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913626    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913628    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913630    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913633    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913635    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913638    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913640    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913643    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913646    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913649    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913651    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:15.916684 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913653    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913656    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913658    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913661    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913663    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913666    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913668    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913670    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913673    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913676    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913678    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913681    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913684    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913687    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913689    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913691    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913694    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913696    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913698    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:15.917185 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913701    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913704    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913706    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913708    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913711    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913714    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913716    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913718    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913723    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913726    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913730    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913733    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913735    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913738    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913741    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913743    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913746    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913749    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913751    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913753    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:15.917661 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913756    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913758    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913761    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913764    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913766    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913768    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913771    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913773    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913776    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913778    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913781    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913783    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913786    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913789    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913793    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913795    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913797    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913800    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.913802    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913876    2572 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913911    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 12:47:15.918140 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913917    2572 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913921    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913925    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913928    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913932    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913936    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913939    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913942    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913945    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913948    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913951    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913954    2572 flags.go:64] FLAG: --cgroup-root=""
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913957    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913959    2572 flags.go:64] FLAG: --client-ca-file=""
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913965    2572 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913968    2572 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913973    2572 flags.go:64] FLAG: --cluster-domain=""
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913976    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913979    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913982    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913985    2572 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913988    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913991    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 12:47:15.918656 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913994    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.913997    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914000    2572 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914003    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914006    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914009    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914011    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914015    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914018    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914021    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914024    2572 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914027    2572 flags.go:64] FLAG: --enable-server="true"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914029    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914033    2572 flags.go:64] FLAG: --event-burst="100"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914036    2572 flags.go:64] FLAG: --event-qps="50"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914039    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914042    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914045    2572 flags.go:64] FLAG: --eviction-hard=""
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914048    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914051    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914054    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914056    2572 flags.go:64] FLAG: --eviction-soft=""
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914059    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914063    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914072    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 12:47:15.919204 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914075    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914077    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914080    2572 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914083    2572 flags.go:64] FLAG: --feature-gates=""
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914087    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914090    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914092    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914095    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914098    2572 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914102    2572 flags.go:64] FLAG: --help="false"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914105    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-247.ec2.internal"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914108    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914111    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914113    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914116    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914120    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914124    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914127    2572 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914129    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914132    2572 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914135    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914138    2572 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914141    2572 flags.go:64] FLAG: --kube-reserved=""
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914144    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 12:47:15.919865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914146    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914149    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914152    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914155    2572 flags.go:64] FLAG: --lock-file=""
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914157    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914160    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914164    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914170    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914173    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914175    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914178    2572 flags.go:64] FLAG: --logging-format="text"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914181    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914184    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914187    2572 flags.go:64] FLAG: --manifest-url=""
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914189    2572 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914193    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914196    2572 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914200    2572 flags.go:64] FLAG: --max-pods="110"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914203    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914206    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914208    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914211    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914214    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914217    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914221    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 12:47:15.920467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914232    2572 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914235    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914238    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914241    2572 flags.go:64] FLAG: --pod-cidr=""
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914243    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914249    2572 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914252    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914254    2572 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914257    2572 flags.go:64] FLAG: --port="10250"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914260    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914263    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef56dffd7e65e0f1"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914266    2572 flags.go:64] FLAG: --qos-reserved=""
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914269    2572 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914272    2572 flags.go:64] FLAG: --register-node="true"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914277    2572 flags.go:64] FLAG: --register-with-taints=""
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914280    2572 flags.go:64] FLAG: --registry-burst="10"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914286    2572 flags.go:64] FLAG: --registry-qps="5"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914289    2572 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914292    2572 flags.go:64] FLAG: --reserved-memory=""
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914295    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914298    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914301    2572 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914304    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914306    2572 flags.go:64] FLAG: --runonce="false"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914309    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 12:47:15.921072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914312    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914329    2572 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914333    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914338    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914341    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914344    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914349    2572 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914352    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914354    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914357    2572 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914360    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914363    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914365    2572 flags.go:64] FLAG: --system-cgroups=""
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914368    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914374    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914376    2572 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914379    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914383    2572 flags.go:64] FLAG: --tls-min-version=""
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914386    2572 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914388    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914391    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914395    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914397    2572 flags.go:64] FLAG: --v="2"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914401    2572 flags.go:64] FLAG: --version="false"
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914405    2572 flags.go:64] FLAG: --vmodule=""
Sep 11 12:47:15.921696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914409    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.914412    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914520    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914524    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914528    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914530    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914533    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914536    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914538    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914540    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914543    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914546    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914549    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914552    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914555    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914557    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914560    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914562    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914565    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:15.922302 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914567    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914570    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914573    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914575    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914578    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914580    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914583    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914585    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914588    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914591    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914594    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914596    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914599    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914607    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914610    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914613    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914616    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914618    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914621    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914623    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:15.922782 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914626    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914628    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914631    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914633    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914636    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914638    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914642    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914644    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914647    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914649    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914652    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914654    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914656    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914659    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914661    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914664    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914666    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914669    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914672    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914676    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:15.923267 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914679    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914682    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914685    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914687    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914690    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914692    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914695    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914697    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914699    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914702    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914704    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914707    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914709    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914711    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914714    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914716    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914718    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914722    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914727    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914730    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:15.923767 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914732    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914735    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914737    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914740    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914742    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914744    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914747    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914749    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914752    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914754    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914756    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914759    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914761    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914764    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914768    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914772    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914775    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914777    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914779    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:15.924245 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914787    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914790    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.914793    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.915616    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.923546    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.923560    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.924334    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.924342    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924418    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924424    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924427    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924430    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924433    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924437    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:15.924723 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924441    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924444    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924448    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924451    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924454    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924459    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924464    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924469    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924473    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924476    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924479    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924482    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924485    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924487    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924490    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924492    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924495    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924498    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924501    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:15.925081 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924504    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924508    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924511    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924514    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924517    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924520    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924523    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924526    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924529    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924531    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924534    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924537    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924542    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924546    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924551    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924555    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924558    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924560    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924562    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:15.925547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924565    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924567    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924570    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924572    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924574    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924577    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924579    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924582    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924585    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924587    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924590    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924593    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924595    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924598    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924601    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924603    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924606    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924609    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924611    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:15.925999 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924615    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924619    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924624    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924629    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924633    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924638    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924641    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924644    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924646    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924649    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924651    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924654    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924656    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924677    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924681    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924684    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924687    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924690    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924694    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924696    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:15.926480 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924699    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924702    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924707    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924711    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924715    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924720    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924723    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924727    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924730    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924732    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924735    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924738    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924741    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924743    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924746    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924748    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:15.926984 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.924753    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924872    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924880    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924885    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924888    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924891    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924894    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924897    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924899    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924902    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924904    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924907    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924910    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924913    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924915    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924918    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924921    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924923    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924926    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924928    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:47:15.927382 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924931    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924933    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924937    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924940    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924944    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924948    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924953    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924958    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924963    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924967    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924969    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924972    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924975    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924977    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924980    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924982    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924985    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924987    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924989    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:47:15.927878 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924992    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924994    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.924997    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925000    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925002    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925005    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925007    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925009    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925012    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925014    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925016    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925019    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925021    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925024    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925026    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925029    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925034    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925038    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925044    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925049    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:47:15.928487 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925052    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925054    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925057    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925059    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925061    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925064    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925066    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925069    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925071    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925073    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925076    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925078    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925080    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925083    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925086    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925089    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925093    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925096    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925098    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:47:15.928969 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925101    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925103    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925106    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925108    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925113    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925117    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925121    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925126    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925130    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925132    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925135    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925137    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925142    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925146    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925149    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925152    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925155    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925157    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925160    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925163    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:47:15.929446 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925166    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:47:15.929965 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:15.925168    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:47:15.929965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.925173    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:47:15.929965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.925278    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 12:47:15.929965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.927533    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 12:47:15.929965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.928584    2572 server.go:1019] "Starting client certificate rotation"
Sep 11 12:47:15.929965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.928681    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:47:15.929965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.928735    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:47:15.932083 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.932069    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:47:15.933176 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.933159    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:47:15.952425 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.952408    2572 log.go:25] "Validated CRI v1 runtime API"
Sep 11 12:47:15.956446 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.956430    2572 log.go:25] "Validated CRI v1 image API"
Sep 11 12:47:15.957289 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.957267    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 12:47:15.959761 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.959733    2572 fs.go:135] Filesystem UUIDs: map[18fd7e90-2bbd-445e-a7c8-1f0be70a73f0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c3816ca8-c7f9-4f2c-9663-1f43efdcf3df:/dev/nvme0n1p3]
Sep 11 12:47:15.959844 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.959760    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 12:47:15.964352 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.964328    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:47:15.965041 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.964931    2572 manager.go:216] Machine: {Timestamp:2026-09-11 12:47:15.96346327 +0000 UTC m=+0.342989197 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101654 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e9770fcf50a15f1da9e38a43b061a SystemUUID:ec2e9770-fcf5-0a15-f1da-9e38a43b061a BootID:7904c034-7612-458d-8aba-327116f75d4e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:bf:8c:9b:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:bf:8c:9b:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:12:1f:c2:41:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 12:47:15.965041 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.965036    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 12:47:15.965141 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.965114    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 12:47:15.968529 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.968508    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 12:47:15.968670 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.968532    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 12:47:15.969381 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.969371    2572 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 12:47:15.969418 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.969384    2572 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 12:47:15.969418 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.969392    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:47:15.969418 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.969410    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:47:15.970712 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.970702    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 12:47:15.974354 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974342    2572 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:47:15.974461 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974451    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 12:47:15.974504 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974479    2572 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 12:47:15.974504 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974490    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 12:47:15.974504 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974504    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 12:47:15.974607 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974512    2572 kubelet.go:398] "Adding apiserver pod source"
Sep 11 12:47:15.974607 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974523    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 12:47:15.974930 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974905    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:47:15.974965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.974941    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:47:15.977382 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.977359    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 12:47:15.981189 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.981171    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 12:47:15.981259 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.981204    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 12:47:15.983164 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983151    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983168    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983174    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983179    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983187    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983192    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983206    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983211    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983217    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983222    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983230    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 12:47:15.983247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983236    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 12:47:15.983719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983282    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 12:47:15.983719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.983288    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 12:47:15.986065 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:15.986044    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 12:47:15.986065 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.986058    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 12:47:15.986166 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:15.986045    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 12:47:15.987423 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.987411    2572 server.go:1268] "Started kubelet"
Sep 11 12:47:15.987517 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.987495    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 12:47:15.987577 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.987501    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 12:47:15.987577 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.987544    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 12:47:15.988279 ip-10-0-136-247 systemd[1]: Started Kubernetes Kubelet.
Sep 11 12:47:15.989395 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.989380    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 12:47:15.989689 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.989674    2572 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 12:47:15.993100 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:15.993080    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 12:47:15.996109 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.996096    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 12:47:15.996192 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.996111    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 12:47:15.996192 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:15.996178    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:15.996886 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.996850    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 12:47:15.996886 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.996854    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 12:47:15.996886 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.996874    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 12:47:15.997072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.996925    2572 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 12:47:15.997072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.996935    2572 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 12:47:15.997072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997006    2572 factory.go:55] Registering systemd factory
Sep 11 12:47:15.997072 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997020    2572 factory.go:223] Registration of the systemd container factory successfully
Sep 11 12:47:15.997267 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997248    2572 factory.go:153] Registering CRI-O factory
Sep 11 12:47:15.997267 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997268    2572 factory.go:223] Registration of the crio container factory successfully
Sep 11 12:47:15.997443 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997310    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 12:47:15.997443 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997346    2572 factory.go:103] Registering Raw factory
Sep 11 12:47:15.997443 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997363    2572 manager.go:1196] Started watching for new ooms in manager
Sep 11 12:47:15.997641 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:15.997629    2572 manager.go:349] Starting recovery of all containers
Sep 11 12:47:16.003173 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.003147    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-62499"
Sep 11 12:47:16.008538 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.008268    2572 manager.go:354] Recovery completed
Sep 11 12:47:16.010765 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.010741    2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 12:47:16.011736 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.011721    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-62499"
Sep 11 12:47:16.012048 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.012027    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 12:47:16.012176 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.012153    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 12:47:16.013135 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.012044    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-247.ec2.internal.18d445041fb9bca2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-247.ec2.internal,UID:ip-10-0-136-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-247.ec2.internal,},FirstTimestamp:2026-09-11 12:47:15.98738141 +0000 UTC m=+0.366907340,LastTimestamp:2026-09-11 12:47:15.98738141 +0000 UTC m=+0.366907340,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-247.ec2.internal,}"
Sep 11 12:47:16.013750 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.013739    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:16.015433 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.015418    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:16.015495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.015445    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:16.015495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.015455    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:16.016067 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.016053    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 12:47:16.016113 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.016068    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 12:47:16.016113 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.016066    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:16.016113 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.016085    2572 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:47:16.016718 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.016704    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:16.016770 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.016729    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:16.016770 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.016739    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:16.017082 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.017069    2572 policy_none.go:49] "None policy: Start"
Sep 11 12:47:16.017117 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.017087    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 12:47:16.017117 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.017099    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 12:47:16.018020 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.018010    2572 policy_none.go:47] "Start"
Sep 11 12:47:16.055907 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.055889    2572 manager.go:337] "Starting Device Plugin manager"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.055923    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.055933    2572 server.go:87] "Starting device plugin registration server"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.056174    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.056184    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.056398    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.056472    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.056478    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.056887    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 12:47:16.071007 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.056925    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.131820 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.131794    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 12:47:16.133146 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.133127    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 12:47:16.133225 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.133169    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 12:47:16.133225 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.133188    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 12:47:16.133225 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.133221    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 12:47:16.135937 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.135921    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:16.157122 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.157078    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:16.159053 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.159040    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:16.159109 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.159069    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:16.159109 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.159083    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:16.159191 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.159113    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.167377 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.167363    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.167493 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.167383    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-247.ec2.internal\": node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.183108 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.183090    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.234022 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.233990    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal"]
Sep 11 12:47:16.234088 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.234064    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:16.234900 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.234884    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:16.234964 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.234912    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:16.234964 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.234920    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:16.237195 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237183    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:16.237384 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237370    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.237438 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237413    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:16.237881 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237862    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:16.237975 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237869    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:16.237975 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237912    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:16.237975 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237924    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:16.237975 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237895    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:16.238118 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.237986    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:16.240145 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.240130    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.240215 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.240155    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:47:16.240804 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.240790    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:47:16.240877 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.240818    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:47:16.240877 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.240831    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:47:16.267146 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.267128    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-247.ec2.internal\" not found" node="ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.271342 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.271312    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-247.ec2.internal\" not found" node="ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.283370 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.283354    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.297822 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.297658    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43c8c6b3b00598aed29c27a9884f2478-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal\" (UID: \"43c8c6b3b00598aed29c27a9884f2478\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.297913 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.297832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43c8c6b3b00598aed29c27a9884f2478-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal\" (UID: \"43c8c6b3b00598aed29c27a9884f2478\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.297913 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.297857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5237685c0cfb0624e595569b1a41ac46-config\") pod \"kube-apiserver-proxy-ip-10-0-136-247.ec2.internal\" (UID: \"5237685c0cfb0624e595569b1a41ac46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.383561 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.383538    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.398906 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.398888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43c8c6b3b00598aed29c27a9884f2478-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal\" (UID: \"43c8c6b3b00598aed29c27a9884f2478\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.398967 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.398911    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43c8c6b3b00598aed29c27a9884f2478-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal\" (UID: \"43c8c6b3b00598aed29c27a9884f2478\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.398967 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.398937    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5237685c0cfb0624e595569b1a41ac46-config\") pod \"kube-apiserver-proxy-ip-10-0-136-247.ec2.internal\" (UID: \"5237685c0cfb0624e595569b1a41ac46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.399047 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.398978    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43c8c6b3b00598aed29c27a9884f2478-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal\" (UID: \"43c8c6b3b00598aed29c27a9884f2478\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.399047 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.399002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5237685c0cfb0624e595569b1a41ac46-config\") pod \"kube-apiserver-proxy-ip-10-0-136-247.ec2.internal\" (UID: \"5237685c0cfb0624e595569b1a41ac46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.399047 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.398978    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43c8c6b3b00598aed29c27a9884f2478-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal\" (UID: \"43c8c6b3b00598aed29c27a9884f2478\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.484403 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.484313    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.569884 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.569855    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.573379 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.573361    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.584682 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.584661    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.685241 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.685215    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.785807 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.785744    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-247.ec2.internal\" not found"
Sep 11 12:47:16.834296 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.834274    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:16.896777 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.896757    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.907654 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.907640    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:47:16.909289 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.909276    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal"
Sep 11 12:47:16.919544 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.919532    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:47:16.928681 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.928666    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 12:47:16.928789 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.928773    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:47:16.928823 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.928806    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:47:16.974972 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.974955    2572 apiserver.go:52] "Watching apiserver"
Sep 11 12:47:16.989715 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.989694    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 12:47:16.991573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.991004    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-bqhc5","openshift-multus/network-metrics-daemon-c2d6c","openshift-network-diagnostics/network-check-target-9znrk","openshift-ovn-kubernetes/ovnkube-node-cl228","kube-system/konnectivity-agent-rprwc","kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl","openshift-cluster-node-tuning-operator/tuned-22pmf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal","openshift-multus/multus-vrlfl","openshift-network-operator/iptables-alerter-hgvwk","kube-system/global-pull-secret-syncer-stvxq","openshift-dns/node-resolver-sw2tq","openshift-image-registry/node-ca-w74bf"]
Sep 11 12:47:16.993773 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.993755    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:16.995668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.995645    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 12:47:16.995765 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.995681    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 12:47:16.995765 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.995703    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 12:47:16.995765 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.995733    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lk9c9\""
Sep 11 12:47:16.995917 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.995884    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:16.996184 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.996172    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 12:47:16.997632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.997616    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 12:47:16.997830 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.997810    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ckzwv\""
Sep 11 12:47:16.997928 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.997853    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 12:47:16.998045 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:16.998031    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:16.998108 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:16.998088    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:17.000242 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.000223    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.001910 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.001894    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 12:47:17.002089 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-registration-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.002155 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002106    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-device-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.002155 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-etc-selinux\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.002256 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002177    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqwzj\" (UniqueName: \"kubernetes.io/projected/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-kube-api-access-pqwzj\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.002256 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002207    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jkqzh\""
Sep 11 12:47:17.002256 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002215    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73599d33-dd5d-449d-9d91-d2f315faa922-hosts-file\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.002256 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:17.002460 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002276    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.002460 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002300    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-socket-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.002460 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002372    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 12:47:17.002460 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-sys-fs\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.002460 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73599d33-dd5d-449d-9d91-d2f315faa922-tmp-dir\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.002460 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85jcf\" (UniqueName: \"kubernetes.io/projected/73599d33-dd5d-449d-9d91-d2f315faa922-kube-api-access-85jcf\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.002460 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002422    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 12:47:17.002766 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002572    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.002766 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002609    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 12:47:17.002766 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002640    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 12:47:17.002766 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.002651    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 12:47:17.004824 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.004806    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.004907 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.004850    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 12:47:17.004962 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.004914    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 12:47:17.005178 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.005163    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bnkbp\""
Sep 11 12:47:17.006568 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.006552    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 12:47:17.006568 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.006563    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mhld2\""
Sep 11 12:47:17.006699 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.006652    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 12:47:17.006699 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.006653    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 12:47:17.007083 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.007066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.007543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.007526    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:47:17.008811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.008651    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cxqnl\""
Sep 11 12:47:17.008811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.008751    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:47:17.008811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.008801    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 12:47:17.009495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.009479    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.011643 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.011597    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 12:47:17.011643 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.011621    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 12:47:17.011808 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.011623    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 12:47:17.011808 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.011755    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s9vt6\""
Sep 11 12:47:17.011808 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.011756    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:17.011933 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.011820    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:17.011933 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.011870    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 12:47:17.011933 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.011902    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 12:47:17.014086 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.014071    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.014471 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.014450    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 12:42:16 +0000 UTC" deadline="2028-02-15 09:44:17.248150947 +0000 UTC"
Sep 11 12:47:17.014510 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.014471    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12524h57m0.233681469s"
Sep 11 12:47:17.017524 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.015875    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 12:47:17.017524 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.015898    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cwfkk\""
Sep 11 12:47:17.017524 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.016861    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:17.018025 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.018001    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.019788 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.019762    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 12:47:17.019872 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.019801    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 12:47:17.019919 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.019893    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:47:17.019965 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.019952    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9pcqx\""
Sep 11 12:47:17.020396 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.020377    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.020456 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.020440    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:17.032502 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.032484    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7r8kq"
Sep 11 12:47:17.040573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.040514    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7r8kq"
Sep 11 12:47:17.097774 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.097756    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 12:47:17.102769 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.102749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqwzj\" (UniqueName: \"kubernetes.io/projected/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-kube-api-access-pqwzj\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.102880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.102778    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-cni-multus\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.102880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.102796    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-systemd-units\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.102880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.102836    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-daemon-config\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.103048 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.102933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-kubernetes\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.103048 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.102958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.103048 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.102982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.103048 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2r8\" (UniqueName: \"kubernetes.io/projected/ee68c729-1d1d-45d5-b526-e1f0710035fa-kube-api-access-bd2r8\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.103048 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-systemd\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.103277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103056    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.103277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103080    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-etc-selinux\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.103277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73599d33-dd5d-449d-9d91-d2f315faa922-hosts-file\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.103277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103214    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73599d33-dd5d-449d-9d91-d2f315faa922-hosts-file\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.103277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103211    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-etc-selinux\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.103277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103237    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103277    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-socket-dir-parent\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysctl-d\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-var-lib-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103372    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be1e7525-a81d-417f-ae9c-2511993d3d86-serviceca\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5744b278-b485-4b4c-8cec-86ec7f032d01-tmp\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103420    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-cnibin\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-cni-bin\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-conf-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-sys\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.103573 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103573    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103594    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17138cd4-cf7b-42b4-a15a-5993daf42915-ovn-node-metrics-cert\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103614    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-system-cni-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103634    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qgr\" (UniqueName: \"kubernetes.io/projected/5a3361e2-8849-41eb-b8c6-54df75b7e94c-kube-api-access-q7qgr\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-run-netns\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysconfig\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103709    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-kubelet-config\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-env-overrides\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103756    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-registration-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103782    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-cni-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103804    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-hostroot\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103825    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-systemd\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103848    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-registration-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103871    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-etc-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b575e23-c420-44fc-8582-1f7ada596cbd-agent-certs\") pod \"konnectivity-agent-rprwc\" (UID: \"2b575e23-c420-44fc-8582-1f7ada596cbd\") " pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73599d33-dd5d-449d-9d91-d2f315faa922-tmp-dir\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.104099 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103935    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jcf\" (UniqueName: \"kubernetes.io/projected/73599d33-dd5d-449d-9d91-d2f315faa922-kube-api-access-85jcf\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a3361e2-8849-41eb-b8c6-54df75b7e94c-cni-binary-copy\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.103978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-slash\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-cni-netd\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104022    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysctl-conf\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6f42533-c530-4676-aa93-98d133c5706b-host-slash\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104105    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-log-socket\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-run-ovn-kubernetes\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7rwm\" (UniqueName: \"kubernetes.io/projected/17138cd4-cf7b-42b4-a15a-5993daf42915-kube-api-access-f7rwm\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrb8\" (UniqueName: \"kubernetes.io/projected/be1e7525-a81d-417f-ae9c-2511993d3d86-kube-api-access-ncrb8\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.104668 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73599d33-dd5d-449d-9d91-d2f315faa922-tmp-dir\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104228    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjm7\" (UniqueName: \"kubernetes.io/projected/3678675e-a199-4e06-9951-1a3f01f03feb-kube-api-access-7rjm7\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-modprobe-d\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbj54\" (UniqueName: \"kubernetes.io/projected/5744b278-b485-4b4c-8cec-86ec7f032d01-kube-api-access-bbj54\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-cni-bin\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104879    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-ovnkube-config\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104901    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-system-cni-dir\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-multus-certs\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.104979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-etc-kubernetes\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.105008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-var-lib-kubelet\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-ovnkube-script-lib\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-cnibin\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-sys-fs\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105156    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105158    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-run\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-lib-modules\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105228    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-tuned\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105252    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-node-log\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105264    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-sys-fs\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-socket-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-k8s-cni-cncf-io\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105406    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-netns\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.105437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-kubelet\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-dbus\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-ovn\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b575e23-c420-44fc-8582-1f7ada596cbd-konnectivity-ca\") pod \"konnectivity-agent-rprwc\" (UID: \"2b575e23-c420-44fc-8582-1f7ada596cbd\") " pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-socket-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-device-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105567    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-host\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105586    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-device-dir\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105590    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfg4d\" (UniqueName: \"kubernetes.io/projected/d6f42533-c530-4676-aa93-98d133c5706b-kube-api-access-zfg4d\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105614    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be1e7525-a81d-417f-ae9c-2511993d3d86-host\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6f42533-c530-4676-aa93-98d133c5706b-iptables-alerter-script\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.105983 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.105659    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-kubelet\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.110541 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.110509    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:17.110648 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.110538    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 12:47:17.110648 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.110547    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:17.110648 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.110560    2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccj7z for pod openshift-network-diagnostics/network-check-target-9znrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:17.110648 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.110631    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z podName:5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:17.610599183 +0000 UTC m=+1.990125116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ccj7z" (UniqueName: "kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z") pod "network-check-target-9znrk" (UID: "5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:17.113938 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.113922    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqwzj\" (UniqueName: \"kubernetes.io/projected/c3a5692e-1c87-4338-b67a-28b4aa8ac62e-kube-api-access-pqwzj\") pod \"aws-ebs-csi-driver-node-zn4zl\" (UID: \"c3a5692e-1c87-4338-b67a-28b4aa8ac62e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.114029 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.113983    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85jcf\" (UniqueName: \"kubernetes.io/projected/73599d33-dd5d-449d-9d91-d2f315faa922-kube-api-access-85jcf\") pod \"node-resolver-sw2tq\" (UID: \"73599d33-dd5d-449d-9d91-d2f315faa922\") " pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.206916 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.206884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysctl-conf\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.206916 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.206914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6f42533-c530-4676-aa93-98d133c5706b-host-slash\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.206929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-log-socket\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.206953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-run-ovn-kubernetes\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.206969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7rwm\" (UniqueName: \"kubernetes.io/projected/17138cd4-cf7b-42b4-a15a-5993daf42915-kube-api-access-f7rwm\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.206982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrb8\" (UniqueName: \"kubernetes.io/projected/be1e7525-a81d-417f-ae9c-2511993d3d86-kube-api-access-ncrb8\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-log-socket\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6f42533-c530-4676-aa93-98d133c5706b-host-slash\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207033    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-run-ovn-kubernetes\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysctl-conf\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjm7\" (UniqueName: \"kubernetes.io/projected/3678675e-a199-4e06-9951-1a3f01f03feb-kube-api-access-7rjm7\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-modprobe-d\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbj54\" (UniqueName: \"kubernetes.io/projected/5744b278-b485-4b4c-8cec-86ec7f032d01-kube-api-access-bbj54\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-cni-bin\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207182    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-ovnkube-config\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207206    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-system-cni-dir\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-multus-certs\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207229    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-modprobe-d\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-cni-bin\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-etc-kubernetes\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-system-cni-dir\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207288    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-etc-kubernetes\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207335    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-multus-certs\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-var-lib-kubelet\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-var-lib-kubelet\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207379    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-ovnkube-script-lib\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207403    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-cnibin\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207429    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-run\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207450    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-cnibin\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-lib-modules\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207490    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-tuned\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.207754 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-node-log\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207552    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-run\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-k8s-cni-cncf-io\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207589    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-lib-modules\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-netns\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207601    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-netns\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-kubelet\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207698    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-node-log\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-run-k8s-cni-cncf-io\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207717    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-dbus\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207793    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-kubelet\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207806    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-ovnkube-config\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207821    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-ovn\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b575e23-c420-44fc-8582-1f7ada596cbd-konnectivity-ca\") pod \"konnectivity-agent-rprwc\" (UID: \"2b575e23-c420-44fc-8582-1f7ada596cbd\") " pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207860    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-dbus\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207894    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-ovnkube-script-lib\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.208550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-host\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207936    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-host\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207951    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfg4d\" (UniqueName: \"kubernetes.io/projected/d6f42533-c530-4676-aa93-98d133c5706b-kube-api-access-zfg4d\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207970    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be1e7525-a81d-417f-ae9c-2511993d3d86-host\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207985    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6f42533-c530-4676-aa93-98d133c5706b-iptables-alerter-script\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.207899    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-ovn\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be1e7525-a81d-417f-ae9c-2511993d3d86-host\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208102    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-kubelet\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-cni-multus\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-systemd-units\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208203    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-kubelet\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-daemon-config\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208241    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-kubernetes\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208259    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-cni-multus\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208357    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b575e23-c420-44fc-8582-1f7ada596cbd-konnectivity-ca\") pod \"konnectivity-agent-rprwc\" (UID: \"2b575e23-c420-44fc-8582-1f7ada596cbd\") " pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208432    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-kubernetes\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.209437 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208494    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2r8\" (UniqueName: \"kubernetes.io/projected/ee68c729-1d1d-45d5-b526-e1f0710035fa-kube-api-access-bd2r8\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-systemd\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208535    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6f42533-c530-4676-aa93-98d133c5706b-iptables-alerter-script\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-socket-dir-parent\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysctl-d\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208637    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-var-lib-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be1e7525-a81d-417f-ae9c-2511993d3d86-serviceca\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5744b278-b485-4b4c-8cec-86ec7f032d01-tmp\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-cnibin\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-cni-bin\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208779    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-conf-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-sys\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208834    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee68c729-1d1d-45d5-b526-e1f0710035fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.210224 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17138cd4-cf7b-42b4-a15a-5993daf42915-ovn-node-metrics-cert\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-system-cni-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208886    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qgr\" (UniqueName: \"kubernetes.io/projected/5a3361e2-8849-41eb-b8c6-54df75b7e94c-kube-api-access-q7qgr\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-run-netns\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysconfig\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208965    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208978    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-kubelet-config\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209017    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-env-overrides\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209034    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-kubelet-config\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-cni-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-hostroot\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209088    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-cnibin\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-systemd\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209117    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-host-var-lib-cni-bin\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-etc-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209149    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-conf-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b575e23-c420-44fc-8582-1f7ada596cbd-agent-certs\") pod \"konnectivity-agent-rprwc\" (UID: \"2b575e23-c420-44fc-8582-1f7ada596cbd\") " pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.210880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209187    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-sys\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209203    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a3361e2-8849-41eb-b8c6-54df75b7e94c-cni-binary-copy\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209217    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-slash\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-cni-netd\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209262    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-daemon-config\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.208522    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-systemd-units\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.209433    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209485    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysctl-d\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.209518    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:47:17.709496219 +0000 UTC m=+2.089022149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209524    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-system-cni-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209533    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-var-lib-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-run-netns\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209697    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-sysconfig\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209742    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-slash\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209913    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17138cd4-cf7b-42b4-a15a-5993daf42915-env-overrides\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.209974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-host-cni-netd\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-run-systemd\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210172    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-systemd\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210193    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a3361e2-8849-41eb-b8c6-54df75b7e94c-cni-binary-copy\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210240    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-cni-dir\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210248    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-hostroot\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210255    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5744b278-b485-4b4c-8cec-86ec7f032d01-etc-tuned\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210278    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17138cd4-cf7b-42b4-a15a-5993daf42915-etc-openvswitch\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.210294    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210360    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a3361e2-8849-41eb-b8c6-54df75b7e94c-multus-socket-dir-parent\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.210366    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret podName:2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:17.710351107 +0000 UTC m=+2.089877040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret") pod "global-pull-secret-syncer-stvxq" (UID: "2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be1e7525-a81d-417f-ae9c-2511993d3d86-serviceca\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.210668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee68c729-1d1d-45d5-b526-e1f0710035fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.211945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.211573    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17138cd4-cf7b-42b4-a15a-5993daf42915-ovn-node-metrics-cert\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.212367 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.212205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5744b278-b485-4b4c-8cec-86ec7f032d01-tmp\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.212367 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.212352    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b575e23-c420-44fc-8582-1f7ada596cbd-agent-certs\") pod \"konnectivity-agent-rprwc\" (UID: \"2b575e23-c420-44fc-8582-1f7ada596cbd\") " pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.214733 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.214713    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrb8\" (UniqueName: \"kubernetes.io/projected/be1e7525-a81d-417f-ae9c-2511993d3d86-kube-api-access-ncrb8\") pod \"node-ca-w74bf\" (UID: \"be1e7525-a81d-417f-ae9c-2511993d3d86\") " pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.215367 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.215349    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7rwm\" (UniqueName: \"kubernetes.io/projected/17138cd4-cf7b-42b4-a15a-5993daf42915-kube-api-access-f7rwm\") pod \"ovnkube-node-cl228\" (UID: \"17138cd4-cf7b-42b4-a15a-5993daf42915\") " pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.215604 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.215584    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjm7\" (UniqueName: \"kubernetes.io/projected/3678675e-a199-4e06-9951-1a3f01f03feb-kube-api-access-7rjm7\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:17.217708 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.217686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbj54\" (UniqueName: \"kubernetes.io/projected/5744b278-b485-4b4c-8cec-86ec7f032d01-kube-api-access-bbj54\") pod \"tuned-22pmf\" (UID: \"5744b278-b485-4b4c-8cec-86ec7f032d01\") " pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.217846 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.217832    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qgr\" (UniqueName: \"kubernetes.io/projected/5a3361e2-8849-41eb-b8c6-54df75b7e94c-kube-api-access-q7qgr\") pod \"multus-vrlfl\" (UID: \"5a3361e2-8849-41eb-b8c6-54df75b7e94c\") " pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.218125 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.218105    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfg4d\" (UniqueName: \"kubernetes.io/projected/d6f42533-c530-4676-aa93-98d133c5706b-kube-api-access-zfg4d\") pod \"iptables-alerter-hgvwk\" (UID: \"d6f42533-c530-4676-aa93-98d133c5706b\") " pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.218682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.218667    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2r8\" (UniqueName: \"kubernetes.io/projected/ee68c729-1d1d-45d5-b526-e1f0710035fa-kube-api-access-bd2r8\") pod \"multus-additional-cni-plugins-bqhc5\" (UID: \"ee68c729-1d1d-45d5-b526-e1f0710035fa\") " pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.296776 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.296697    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c8c6b3b00598aed29c27a9884f2478.slice/crio-a08a7f7ead233f8d34ae4e0c0d6cb3c35d15d04b0a2d97a8fe239a327518b9d5 WatchSource:0}: Error finding container a08a7f7ead233f8d34ae4e0c0d6cb3c35d15d04b0a2d97a8fe239a327518b9d5: Status 404 returned error can't find the container with id a08a7f7ead233f8d34ae4e0c0d6cb3c35d15d04b0a2d97a8fe239a327518b9d5
Sep 11 12:47:17.296997 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.296975    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5237685c0cfb0624e595569b1a41ac46.slice/crio-0fef8bd807786cf9c858c426456a88ad464a39f0d63380f41c63a0f29e446dcc WatchSource:0}: Error finding container 0fef8bd807786cf9c858c426456a88ad464a39f0d63380f41c63a0f29e446dcc: Status 404 returned error can't find the container with id 0fef8bd807786cf9c858c426456a88ad464a39f0d63380f41c63a0f29e446dcc
Sep 11 12:47:17.301792 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.301770    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:47:17.320449 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.320427    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl"
Sep 11 12:47:17.327392 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.327362    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sw2tq"
Sep 11 12:47:17.329547 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.329525    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a5692e_1c87_4338_b67a_28b4aa8ac62e.slice/crio-65fc0c0b94e0d93222fd2a4e26f3355ddf05e203c796b0168798889084bc3ae9 WatchSource:0}: Error finding container 65fc0c0b94e0d93222fd2a4e26f3355ddf05e203c796b0168798889084bc3ae9: Status 404 returned error can't find the container with id 65fc0c0b94e0d93222fd2a4e26f3355ddf05e203c796b0168798889084bc3ae9
Sep 11 12:47:17.335626 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.335607    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73599d33_dd5d_449d_9d91_d2f315faa922.slice/crio-9e53d429b7ca4d9a004150edce3a636d1d369e8ed26bde1673e6f6d69600a7df WatchSource:0}: Error finding container 9e53d429b7ca4d9a004150edce3a636d1d369e8ed26bde1673e6f6d69600a7df: Status 404 returned error can't find the container with id 9e53d429b7ca4d9a004150edce3a636d1d369e8ed26bde1673e6f6d69600a7df
Sep 11 12:47:17.346734 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.346719    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:17.355622 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.355604    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:17.356644 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.356623    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17138cd4_cf7b_42b4_a15a_5993daf42915.slice/crio-d4b75b3b569da599a2477f4cea67197da8d67f2d138ea828c29496e0b6634cbb WatchSource:0}: Error finding container d4b75b3b569da599a2477f4cea67197da8d67f2d138ea828c29496e0b6634cbb: Status 404 returned error can't find the container with id d4b75b3b569da599a2477f4cea67197da8d67f2d138ea828c29496e0b6634cbb
Sep 11 12:47:17.363417 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.363397    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b575e23_c420_44fc_8582_1f7ada596cbd.slice/crio-b5262b6629d595648590b4159a3e8e9c9659cf479617d25277781bc3001af07c WatchSource:0}: Error finding container b5262b6629d595648590b4159a3e8e9c9659cf479617d25277781bc3001af07c: Status 404 returned error can't find the container with id b5262b6629d595648590b4159a3e8e9c9659cf479617d25277781bc3001af07c
Sep 11 12:47:17.374039 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.374022    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w74bf"
Sep 11 12:47:17.381883 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.381866    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1e7525_a81d_417f_ae9c_2511993d3d86.slice/crio-d828bcf1807ec735a5c534c7dc5927f8a61cf4ce1a695c173d498f00a52c00ea WatchSource:0}: Error finding container d828bcf1807ec735a5c534c7dc5927f8a61cf4ce1a695c173d498f00a52c00ea: Status 404 returned error can't find the container with id d828bcf1807ec735a5c534c7dc5927f8a61cf4ce1a695c173d498f00a52c00ea
Sep 11 12:47:17.393016 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.393000    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22pmf"
Sep 11 12:47:17.400493 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.400475    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5744b278_b485_4b4c_8cec_86ec7f032d01.slice/crio-26ff2e938698f5e2dadf9ce6e9ec5a1f7c092aaa829b56426be8f738ba1db171 WatchSource:0}: Error finding container 26ff2e938698f5e2dadf9ce6e9ec5a1f7c092aaa829b56426be8f738ba1db171: Status 404 returned error can't find the container with id 26ff2e938698f5e2dadf9ce6e9ec5a1f7c092aaa829b56426be8f738ba1db171
Sep 11 12:47:17.403423 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.403406    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:17.404783 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.404766    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bqhc5"
Sep 11 12:47:17.412100 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.412081    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee68c729_1d1d_45d5_b526_e1f0710035fa.slice/crio-ae4aa491a34937d7f543c644c752cda034c5a3532295de8934db66a0662cbb92 WatchSource:0}: Error finding container ae4aa491a34937d7f543c644c752cda034c5a3532295de8934db66a0662cbb92: Status 404 returned error can't find the container with id ae4aa491a34937d7f543c644c752cda034c5a3532295de8934db66a0662cbb92
Sep 11 12:47:17.418674 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.418661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrlfl"
Sep 11 12:47:17.424488 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.424461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgvwk"
Sep 11 12:47:17.426143 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.426122    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3361e2_8849_41eb_b8c6_54df75b7e94c.slice/crio-33371d3c3c875cceced4c88a1d3fa68367e3d54c3b6299001c299a1149b8c2d3 WatchSource:0}: Error finding container 33371d3c3c875cceced4c88a1d3fa68367e3d54c3b6299001c299a1149b8c2d3: Status 404 returned error can't find the container with id 33371d3c3c875cceced4c88a1d3fa68367e3d54c3b6299001c299a1149b8c2d3
Sep 11 12:47:17.433362 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:17.433332    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f42533_c530_4676_aa93_98d133c5706b.slice/crio-a39579e9590d7133dedff21a2f4b796c63fc4af7ff4fb0fa7df7004ccfcdcaed WatchSource:0}: Error finding container a39579e9590d7133dedff21a2f4b796c63fc4af7ff4fb0fa7df7004ccfcdcaed: Status 404 returned error can't find the container with id a39579e9590d7133dedff21a2f4b796c63fc4af7ff4fb0fa7df7004ccfcdcaed
Sep 11 12:47:17.434862 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.434839    2572 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-hgvwk_openshift-network-operator(d6f42533-c530-4676-aa93-98d133c5706b): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 11 12:47:17.434944 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.434875    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-hgvwk" podUID="d6f42533-c530-4676-aa93-98d133c5706b"
Sep 11 12:47:17.613006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.612976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:17.613152 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.613137    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:17.613191 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.613159    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:17.613191 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.613170    2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccj7z for pod openshift-network-diagnostics/network-check-target-9znrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:17.613264 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.613221    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z podName:5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:18.61320537 +0000 UTC m=+2.992731286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccj7z" (UniqueName: "kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z") pod "network-check-target-9znrk" (UID: "5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:17.714436 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.713825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:17.714436 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.713872    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:17.714436 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.714010    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:17.714436 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.714068    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:47:18.714051074 +0000 UTC m=+3.093577007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:17.714797 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.714770    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:17.714922 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:17.714849    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret podName:2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:18.714826256 +0000 UTC m=+3.094352178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret") pod "global-pull-secret-syncer-stvxq" (UID: "2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:17.808916 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:17.808836    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:18.043574 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.043509    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:42:17 +0000 UTC" deadline="2028-05-02 20:58:03.51862748 +0000 UTC"
Sep 11 12:47:18.043574 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.043571    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14384h10m45.4750614s"
Sep 11 12:47:18.162505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.162360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgvwk" event={"ID":"d6f42533-c530-4676-aa93-98d133c5706b","Type":"ContainerStarted","Data":"a39579e9590d7133dedff21a2f4b796c63fc4af7ff4fb0fa7df7004ccfcdcaed"}
Sep 11 12:47:18.172171 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.172134    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0444a9580f430c7c6b52f78667a80a82198c825805f1f2004fdfdf9aed2b95f5\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-hgvwk" podUID="d6f42533-c530-4676-aa93-98d133c5706b"
Sep 11 12:47:18.183047 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.183015    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerStarted","Data":"ae4aa491a34937d7f543c644c752cda034c5a3532295de8934db66a0662cbb92"}
Sep 11 12:47:18.205279 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.205171    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22pmf" event={"ID":"5744b278-b485-4b4c-8cec-86ec7f032d01","Type":"ContainerStarted","Data":"26ff2e938698f5e2dadf9ce6e9ec5a1f7c092aaa829b56426be8f738ba1db171"}
Sep 11 12:47:18.222305 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.222262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"d4b75b3b569da599a2477f4cea67197da8d67f2d138ea828c29496e0b6634cbb"}
Sep 11 12:47:18.224652 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.224620    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sw2tq" event={"ID":"73599d33-dd5d-449d-9d91-d2f315faa922","Type":"ContainerStarted","Data":"9e53d429b7ca4d9a004150edce3a636d1d369e8ed26bde1673e6f6d69600a7df"}
Sep 11 12:47:18.239207 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.239169    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl" event={"ID":"c3a5692e-1c87-4338-b67a-28b4aa8ac62e","Type":"ContainerStarted","Data":"65fc0c0b94e0d93222fd2a4e26f3355ddf05e203c796b0168798889084bc3ae9"}
Sep 11 12:47:18.251182 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.251147    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrlfl" event={"ID":"5a3361e2-8849-41eb-b8c6-54df75b7e94c","Type":"ContainerStarted","Data":"33371d3c3c875cceced4c88a1d3fa68367e3d54c3b6299001c299a1149b8c2d3"}
Sep 11 12:47:18.274131 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.274096    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w74bf" event={"ID":"be1e7525-a81d-417f-ae9c-2511993d3d86","Type":"ContainerStarted","Data":"d828bcf1807ec735a5c534c7dc5927f8a61cf4ce1a695c173d498f00a52c00ea"}
Sep 11 12:47:18.298138 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.298103    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rprwc" event={"ID":"2b575e23-c420-44fc-8582-1f7ada596cbd","Type":"ContainerStarted","Data":"b5262b6629d595648590b4159a3e8e9c9659cf479617d25277781bc3001af07c"}
Sep 11 12:47:18.313931 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.313899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal" event={"ID":"43c8c6b3b00598aed29c27a9884f2478","Type":"ContainerStarted","Data":"a08a7f7ead233f8d34ae4e0c0d6cb3c35d15d04b0a2d97a8fe239a327518b9d5"}
Sep 11 12:47:18.325771 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.325699    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal" event={"ID":"5237685c0cfb0624e595569b1a41ac46","Type":"ContainerStarted","Data":"0fef8bd807786cf9c858c426456a88ad464a39f0d63380f41c63a0f29e446dcc"}
Sep 11 12:47:18.621462 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.621333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:18.621640 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.621591    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:18.621640 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.621616    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:18.621759 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.621657    2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccj7z for pod openshift-network-diagnostics/network-check-target-9znrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:18.621837 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.621819    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z podName:5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:20.62176401 +0000 UTC m=+5.001289933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccj7z" (UniqueName: "kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z") pod "network-check-target-9znrk" (UID: "5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:18.722093 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.722051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:18.722270 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.722110    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:18.722270 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.722254    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:18.722426 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.722320    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:47:20.722301039 +0000 UTC m=+5.101826972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:18.722817 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.722745    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:18.722817 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:18.722803    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret podName:2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:20.722785834 +0000 UTC m=+5.102311756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret") pod "global-pull-secret-syncer-stvxq" (UID: "2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:18.880539 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:18.880460    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:47:19.044208 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:19.044166    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:42:17 +0000 UTC" deadline="2028-02-17 21:08:24.454776877 +0000 UTC"
Sep 11 12:47:19.044208 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:19.044206    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12584h21m5.410575654s"
Sep 11 12:47:19.134264 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:19.134169    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:19.134452 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:19.134319    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:19.134452 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:19.134417    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:19.134579 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:19.134489    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:19.134579 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:19.134556    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:19.134689 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:19.134630    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:20.637016 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:20.636976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:20.637662 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.637249    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:20.637662 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.637275    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:20.637662 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.637289    2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccj7z for pod openshift-network-diagnostics/network-check-target-9znrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:20.637662 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.637362    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z podName:5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:24.637341946 +0000 UTC m=+9.016867864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccj7z" (UniqueName: "kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z") pod "network-check-target-9znrk" (UID: "5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:20.738259 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:20.738221    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:20.738449 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:20.738268    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:20.738517 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.738479    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:20.738567 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.738548    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret podName:2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:24.738527484 +0000 UTC m=+9.118053421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret") pod "global-pull-secret-syncer-stvxq" (UID: "2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:20.738990 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.738967    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:20.739086 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:20.739033    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:47:24.739016809 +0000 UTC m=+9.118542731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:21.133680 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:21.133587    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:21.133843 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:21.133718    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:21.134118 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:21.134095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:21.134223 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:21.134201    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:21.134291 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:21.134260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:21.134366 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:21.134347    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:23.134173 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:23.134129    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:23.134658 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:23.134260    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:23.134658 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:23.134450    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:23.134658 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:23.134558    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:23.134658 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:23.134626    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:23.134879 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:23.134705    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:24.673849 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:24.673718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:24.674259 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.673885    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:24.674259 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.673913    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:24.674259 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.673923    2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccj7z for pod openshift-network-diagnostics/network-check-target-9znrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:24.674259 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.673978    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z podName:5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:32.673957206 +0000 UTC m=+17.053483123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccj7z" (UniqueName: "kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z") pod "network-check-target-9znrk" (UID: "5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:24.774300 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:24.774251    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:24.774493 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:24.774308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:24.774493 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.774459    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:24.774493 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.774456    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:24.774672 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.774523    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:47:32.774505869 +0000 UTC m=+17.154031809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:24.774672 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:24.774538    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret podName:2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:32.77453162 +0000 UTC m=+17.154057536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret") pod "global-pull-secret-syncer-stvxq" (UID: "2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:25.133466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:25.133385    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:25.133634 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:25.133518    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:25.133634 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:25.133588    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:25.133763 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:25.133670    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:25.134023 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:25.134002    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:25.134124 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:25.134099    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:27.134151 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:27.134118    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:27.134151 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:27.134150    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:27.134694 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:27.134147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:27.134694 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:27.134258    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:27.134694 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:27.134313    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:27.134694 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:27.134413    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:29.134451 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:29.134403    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:29.134451 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:29.134437    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:29.134963 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:29.134571    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:29.134963 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:29.134613    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:29.134963 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:29.134635    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:29.134963 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:29.134805    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:31.133442 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:31.133404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:31.133891 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:31.133538    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:31.133891 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:31.133404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:31.133891 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:31.133646    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:31.133891 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:31.133404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:31.133891 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:31.133722    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:32.736692 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:32.736653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:32.737104 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.736826    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:32.737104 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.736850    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:32.737104 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.736860    2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccj7z for pod openshift-network-diagnostics/network-check-target-9znrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:32.737104 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.736913    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z podName:5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:48.7368997 +0000 UTC m=+33.116425613 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccj7z" (UniqueName: "kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z") pod "network-check-target-9znrk" (UID: "5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:32.837042 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:32.837010    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:32.837042 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:32.837048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:32.837254 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.837137    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:32.837254 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.837154    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:32.837254 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.837188    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:47:48.837175579 +0000 UTC m=+33.216701493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:32.837254 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:32.837209    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret podName:2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71 nodeName:}" failed. No retries permitted until 2026-09-11 12:47:48.83719439 +0000 UTC m=+33.216720309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret") pod "global-pull-secret-syncer-stvxq" (UID: "2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:33.134249 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:33.134209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:33.134416 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:33.134336    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:33.134416 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:33.134342    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:33.134416 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:33.134366    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:33.134514 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:33.134442    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:33.134548 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:33.134513    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:35.134175 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:35.134136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:35.134175 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:35.134170    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:35.134822 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:35.134246    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:35.134822 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:35.134266    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:35.134822 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:35.134373    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:35.134822 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:35.134430    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:37.134413 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:37.134380    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:37.134413 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:37.134401    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:37.134812 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:37.134380    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:37.134812 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:37.134489    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:37.134812 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:37.134586    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:37.134812 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:37.134634    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:38.379098 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.378716    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rprwc" event={"ID":"2b575e23-c420-44fc-8582-1f7ada596cbd","Type":"ContainerStarted","Data":"e7a701300a8da711d196b0a8e1bf462211d82db55a5b083c41347b0f806f6503"}
Sep 11 12:47:38.380175 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.380155    2572 generic.go:356] "Generic (PLEG): container finished" podID="43c8c6b3b00598aed29c27a9884f2478" containerID="3ddd53ed0aa887204787adbf75566de52364304260a1cf742fde9366c1a06f32" exitCode=0
Sep 11 12:47:38.380248 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.380215    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal" event={"ID":"43c8c6b3b00598aed29c27a9884f2478","Type":"ContainerDied","Data":"3ddd53ed0aa887204787adbf75566de52364304260a1cf742fde9366c1a06f32"}
Sep 11 12:47:38.381814 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.381782    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal" event={"ID":"5237685c0cfb0624e595569b1a41ac46","Type":"ContainerStarted","Data":"bd0913d7a1dfeae58a2f1feb28f17be281f2cdd886224e0630e13af57e189934"}
Sep 11 12:47:38.383399 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.383377    2572 generic.go:356] "Generic (PLEG): container finished" podID="ee68c729-1d1d-45d5-b526-e1f0710035fa" containerID="a1dd6f3268619bcf58e230a09e88dee23c9674cd9cb70c08b7a3157886d93b52" exitCode=0
Sep 11 12:47:38.383486 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.383456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerDied","Data":"a1dd6f3268619bcf58e230a09e88dee23c9674cd9cb70c08b7a3157886d93b52"}
Sep 11 12:47:38.384958 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.384942    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22pmf" event={"ID":"5744b278-b485-4b4c-8cec-86ec7f032d01","Type":"ContainerStarted","Data":"710050cfc9282599bc0c8eea4d26180d770afe8d5b4f59fc627175f5b0bb2970"}
Sep 11 12:47:38.387467 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.387450    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:47:38.387778 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.387762    2572 generic.go:356] "Generic (PLEG): container finished" podID="17138cd4-cf7b-42b4-a15a-5993daf42915" containerID="55f93205a191aac45088d8a32d090893111070716f3eba7525baa7cd757f0d0e" exitCode=1
Sep 11 12:47:38.387829 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.387821    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"4ea8b53ad90dc4dcc0012e9d93f973c78eb5d9147cd4d60a53d87dadd5a4c2da"}
Sep 11 12:47:38.387885 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.387868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"ae1bed1a9e1ab06293b79c4f9f731708c2ecebf170324b391185977ca36d6d44"}
Sep 11 12:47:38.387938 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.387914    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"602a1a6e766986a0c4203b14860c605abe39084b43b41ae5700d64dd4495826e"}
Sep 11 12:47:38.387989 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.387944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"898b202fe6005dc358440a883f7aa4028bca09e7ca2b05557734cd1c6be547e7"}
Sep 11 12:47:38.387989 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.387973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerDied","Data":"55f93205a191aac45088d8a32d090893111070716f3eba7525baa7cd757f0d0e"}
Sep 11 12:47:38.388071 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.388007    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"221573340e1d73df1373687f0416c6f5e144a7384e3d364ace8f2f559cf29f4d"}
Sep 11 12:47:38.391239 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.391198    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sw2tq" event={"ID":"73599d33-dd5d-449d-9d91-d2f315faa922","Type":"ContainerStarted","Data":"90be3c163d50951d0334ad2cb707dc9826e4340cce6135f756e4163b7432d8c4"}
Sep 11 12:47:38.393231 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.393202    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl" event={"ID":"c3a5692e-1c87-4338-b67a-28b4aa8ac62e","Type":"ContainerStarted","Data":"be0e9cf7ec49e9f45f3979e45b0946b14d79cf5b851d395d6d4967d616772d29"}
Sep 11 12:47:38.393885 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.393850    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rprwc" podStartSLOduration=2.535387517 podStartE2EDuration="22.393837792s" totalImagesPullingTime="19.858450275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:38.393285417 +0000 UTC m=+22.772811353" watchObservedRunningTime="2026-09-11 12:47:38.393837792 +0000 UTC m=+22.773363727"
Sep 11 12:47:38.394670 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.394653    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrlfl" event={"ID":"5a3361e2-8849-41eb-b8c6-54df75b7e94c","Type":"ContainerStarted","Data":"aa3daa7cfd65dbe21bbaa62b0bbfe9f3ff034df688e9558f7c20e6dc48f7e4d1"}
Sep 11 12:47:38.395969 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.395952    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w74bf" event={"ID":"be1e7525-a81d-417f-ae9c-2511993d3d86","Type":"ContainerStarted","Data":"7e5de4149627cac2a2e32a1a3c703b70889881792c37c1b1abb94f2b2cafea31"}
Sep 11 12:47:38.409360 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.409292    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-22pmf" podStartSLOduration=2.5435601979999998 podStartE2EDuration="22.409277007s" totalImagesPullingTime="19.865716809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:38.408827964 +0000 UTC m=+22.788353900" watchObservedRunningTime="2026-09-11 12:47:38.409277007 +0000 UTC m=+22.788802944"
Sep 11 12:47:38.462669 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.462621    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sw2tq" podStartSLOduration=10.253876622 podStartE2EDuration="22.462604905s" totalImagesPullingTime="12.208728283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:38.46242595 +0000 UTC m=+22.841951886" watchObservedRunningTime="2026-09-11 12:47:38.462604905 +0000 UTC m=+22.842130839"
Sep 11 12:47:38.462993 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.462972    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-247.ec2.internal" podStartSLOduration=21.462965826 podStartE2EDuration="21.462965826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:38.45004306 +0000 UTC m=+22.829568995" watchObservedRunningTime="2026-09-11 12:47:38.462965826 +0000 UTC m=+22.842491762"
Sep 11 12:47:38.479486 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:38.477897    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vrlfl" podStartSLOduration=2.254980229 podStartE2EDuration="22.477877467s" totalImagesPullingTime="20.222897238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:38.476669762 +0000 UTC m=+22.856195697" watchObservedRunningTime="2026-09-11 12:47:38.477877467 +0000 UTC m=+22.857403404"
Sep 11 12:47:39.134920 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.134183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:39.134920 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:39.134307    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:39.134920 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.134697    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:39.134920 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:39.134790    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:39.134920 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.134839    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:39.134920 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:39.134880    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:39.195083 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.195064    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 12:47:39.400912 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.400825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl" event={"ID":"c3a5692e-1c87-4338-b67a-28b4aa8ac62e","Type":"ContainerStarted","Data":"b4b11fc98656714461ffa1e0aeab17edf246e17c9f6dce3f0c5b8464cf125c24"}
Sep 11 12:47:39.402940 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.402912    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal" event={"ID":"43c8c6b3b00598aed29c27a9884f2478","Type":"ContainerStarted","Data":"ca3755ddbe73e1e45d9be41cee931ab9d22743e1d9aace23559a94c6fbcc014c"}
Sep 11 12:47:39.404681 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.404641    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgvwk" event={"ID":"d6f42533-c530-4676-aa93-98d133c5706b","Type":"ContainerStarted","Data":"c6d215be938fa06ecea16dc74b603f98f315fa7b581c53c4d57cffeab35c886a"}
Sep 11 12:47:39.416692 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.416650    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w74bf" podStartSLOduration=3.576948664 podStartE2EDuration="23.416634154s" totalImagesPullingTime="19.83968549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:38.489733978 +0000 UTC m=+22.869259914" watchObservedRunningTime="2026-09-11 12:47:39.416634154 +0000 UTC m=+23.796160088"
Sep 11 12:47:39.417441 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.417404    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-247.ec2.internal" podStartSLOduration=22.417389234 podStartE2EDuration="22.417389234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:39.416776938 +0000 UTC m=+23.796302855" watchObservedRunningTime="2026-09-11 12:47:39.417389234 +0000 UTC m=+23.796915171"
Sep 11 12:47:39.429435 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:39.429402    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hgvwk" podStartSLOduration=23.429387977 podStartE2EDuration="23.429387977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-11 12:47:39.429199386 +0000 UTC m=+23.808725325" watchObservedRunningTime="2026-09-11 12:47:39.429387977 +0000 UTC m=+23.808913917"
Sep 11 12:47:40.069337 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:40.069218    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T12:47:39.195080937Z","UUID":"962c0435-3b70-4e62-8a87-6b5b6f4d77fb","Handler":null,"Name":"","Endpoint":""}
Sep 11 12:47:40.071063 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:40.071043    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 12:47:40.071174 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:40.071072    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 12:47:40.421609 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:40.421584    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:47:40.422022 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:40.421994    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"edc65e5976cb37ca011405d69fc3c9508121b04d2233ed1304ae24a6832fda25"}
Sep 11 12:47:40.424338 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:40.424293    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl" event={"ID":"c3a5692e-1c87-4338-b67a-28b4aa8ac62e","Type":"ContainerStarted","Data":"a83e67ae469102b7761695a8490b0d7a24e0d51a9462f9e672de80640fc4104b"}
Sep 11 12:47:40.441804 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:40.441763    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zn4zl" podStartSLOduration=2.348277385 podStartE2EDuration="24.441748836s" totalImagesPullingTime="22.093471451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:40.441450449 +0000 UTC m=+24.820976386" watchObservedRunningTime="2026-09-11 12:47:40.441748836 +0000 UTC m=+24.821274771"
Sep 11 12:47:41.134137 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:41.134105    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:41.134137 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:41.134152    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:41.134492 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:41.134149    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:41.134492 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:41.134277    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:41.134492 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:41.134419    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:41.134638 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:41.134510    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:41.805995 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:41.805954    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:41.806598 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:41.806577    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:42.428296 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:42.428257    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:42.429025 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:42.428841    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rprwc"
Sep 11 12:47:43.133926 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.133905    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:43.133926 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.133917    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:43.134248 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.133917    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:43.134248 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:43.134013    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:43.134248 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:43.134072    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:43.134248 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:43.134177    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:43.434403 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.434209    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:47:43.435100 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.435068    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"4ac629782ba01aa7c348bd65dfea22221dd208c84d09f4659ca5cff36c17e7cf"}
Sep 11 12:47:43.435458 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.435441    2572 scope.go:117] "RemoveContainer" containerID="55f93205a191aac45088d8a32d090893111070716f3eba7525baa7cd757f0d0e"
Sep 11 12:47:43.435538 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.435467    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:43.435653 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.435629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:43.455517 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:43.455492    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:44.441206 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:44.441120    2572 generic.go:356] "Generic (PLEG): container finished" podID="ee68c729-1d1d-45d5-b526-e1f0710035fa" containerID="d97811d048e7c03027762c05b9d77b2a27519cbaeba32fe61c03a273a62b0f09" exitCode=0
Sep 11 12:47:44.441934 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:44.441422    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerDied","Data":"d97811d048e7c03027762c05b9d77b2a27519cbaeba32fe61c03a273a62b0f09"}
Sep 11 12:47:44.449807 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:44.449781    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:47:44.451514 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:44.451486    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" event={"ID":"17138cd4-cf7b-42b4-a15a-5993daf42915","Type":"ContainerStarted","Data":"f45f06120dd6a71b3fcf024d8249382fee9737f985c249742ae0c1563a57d0bd"}
Sep 11 12:47:44.451666 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:44.451647    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:44.483456 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:44.483432    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:47:44.487418 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:44.487376    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cl228" podStartSLOduration=8.559283165 podStartE2EDuration="28.487361253s" totalImagesPullingTime="19.928078088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:44.486894299 +0000 UTC m=+28.866420271" watchObservedRunningTime="2026-09-11 12:47:44.487361253 +0000 UTC m=+28.866887189"
Sep 11 12:47:45.133756 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.133711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:45.133756 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.133758    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:45.134021 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.133758    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:45.134021 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:45.133837    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:45.134021 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:45.133906    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:45.134175 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:45.134010    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:45.158877 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.158573    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9znrk"]
Sep 11 12:47:45.159342 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.159295    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stvxq"]
Sep 11 12:47:45.160579 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.160558    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c2d6c"]
Sep 11 12:47:45.452092 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.452066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:45.452653 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.452066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:45.452653 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:45.452074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:45.452653 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:45.452171    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:45.452653 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:45.452267    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:45.452653 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:45.452629    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:46.455812 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:46.455778    2572 generic.go:356] "Generic (PLEG): container finished" podID="ee68c729-1d1d-45d5-b526-e1f0710035fa" containerID="ab48769aececafd8ecb8f41e8cdd221224c3c60e39f7a2186e34ed079ab195f1" exitCode=0
Sep 11 12:47:46.456153 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:46.455847    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerDied","Data":"ab48769aececafd8ecb8f41e8cdd221224c3c60e39f7a2186e34ed079ab195f1"}
Sep 11 12:47:47.133874 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:47.133838    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:47.134073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:47.133915    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:47.134073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:47.133931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:47.134073 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:47.134024    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:47.134243 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:47.134163    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:47.134347 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:47.134251    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:48.462043 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:48.462013    2572 generic.go:356] "Generic (PLEG): container finished" podID="ee68c729-1d1d-45d5-b526-e1f0710035fa" containerID="b23a30ef7b0318e0257a8730668c01b59c338f1507a9b22cfcc6e33d879a3e94" exitCode=0
Sep 11 12:47:48.462043 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:48.462056    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerDied","Data":"b23a30ef7b0318e0257a8730668c01b59c338f1507a9b22cfcc6e33d879a3e94"}
Sep 11 12:47:48.753742 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:48.753657    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:48.753880 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.753820    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:47:48.753880 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.753842    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:47:48.753880 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.753853    2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccj7z for pod openshift-network-diagnostics/network-check-target-9znrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:48.753989 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.753903    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z podName:5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4 nodeName:}" failed. No retries permitted until 2026-09-11 12:48:20.753890277 +0000 UTC m=+65.133416191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccj7z" (UniqueName: "kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z") pod "network-check-target-9znrk" (UID: "5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:47:48.854231 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:48.854202    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:48.854398 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:48.854252    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:48.854398 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.854360    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:48.854398 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.854373    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:48.854627 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.854426    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret podName:2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71 nodeName:}" failed. No retries permitted until 2026-09-11 12:48:20.854410745 +0000 UTC m=+65.233936675 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret") pod "global-pull-secret-syncer-stvxq" (UID: "2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:47:48.854627 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:48.854440    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:48:20.85443424 +0000 UTC m=+65.233960159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:47:49.133616 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:49.133540    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:49.133616 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:49.133567    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:49.133799 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:49.133654    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stvxq" podUID="2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71"
Sep 11 12:47:49.133799 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:49.133704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:49.133799 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:49.133783    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9znrk" podUID="5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4"
Sep 11 12:47:49.133900 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:49.133852    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:47:50.331215 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.331181    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-247.ec2.internal" event="NodeReady"
Sep 11 12:47:50.331671 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.331367    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 12:47:50.375036 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.374949    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wcmgr"]
Sep 11 12:47:50.379080 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.378227    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kz47p"]
Sep 11 12:47:50.379080 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.378256    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.380552 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.380529    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 12:47:50.380794 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.380664    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 12:47:50.381027 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.381005    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2v8d4\""
Sep 11 12:47:50.381157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.381142    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.383131 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.383112    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ss7sh\""
Sep 11 12:47:50.383245 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.383167    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 12:47:50.383308 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.383236    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 12:47:50.383399 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.383379    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 12:47:50.389233 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.389207    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wcmgr"]
Sep 11 12:47:50.393526 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.393471    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kz47p"]
Sep 11 12:47:50.465913 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.465814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfnvf\" (UniqueName: \"kubernetes.io/projected/26c0e0cc-5996-4060-aa28-d24a536e799f-kube-api-access-vfnvf\") pod \"ingress-canary-kz47p\" (UID: \"26c0e0cc-5996-4060-aa28-d24a536e799f\") " pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.465913 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.465853    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.466156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.465945    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzkcc\" (UniqueName: \"kubernetes.io/projected/a403e860-0e0a-4068-bbf7-e9eec044085e-kube-api-access-fzkcc\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.466156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.465979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a403e860-0e0a-4068-bbf7-e9eec044085e-tmp-dir\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.466156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.466033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26c0e0cc-5996-4060-aa28-d24a536e799f-cert\") pod \"ingress-canary-kz47p\" (UID: \"26c0e0cc-5996-4060-aa28-d24a536e799f\") " pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.466156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.466085    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a403e860-0e0a-4068-bbf7-e9eec044085e-config-volume\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.566992 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.566955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a403e860-0e0a-4068-bbf7-e9eec044085e-config-volume\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.567165 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.567008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfnvf\" (UniqueName: \"kubernetes.io/projected/26c0e0cc-5996-4060-aa28-d24a536e799f-kube-api-access-vfnvf\") pod \"ingress-canary-kz47p\" (UID: \"26c0e0cc-5996-4060-aa28-d24a536e799f\") " pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.567165 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.567035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.567165 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.567085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzkcc\" (UniqueName: \"kubernetes.io/projected/a403e860-0e0a-4068-bbf7-e9eec044085e-kube-api-access-fzkcc\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.567355 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.567253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a403e860-0e0a-4068-bbf7-e9eec044085e-tmp-dir\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.567423 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.567393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26c0e0cc-5996-4060-aa28-d24a536e799f-cert\") pod \"ingress-canary-kz47p\" (UID: \"26c0e0cc-5996-4060-aa28-d24a536e799f\") " pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.567501 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:50.567479    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:50.567615 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:50.567540    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:47:51.067521256 +0000 UTC m=+35.447047177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:50.567712 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.567683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a403e860-0e0a-4068-bbf7-e9eec044085e-config-volume\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.567956 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.567924    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a403e860-0e0a-4068-bbf7-e9eec044085e-tmp-dir\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.572304 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.572286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26c0e0cc-5996-4060-aa28-d24a536e799f-cert\") pod \"ingress-canary-kz47p\" (UID: \"26c0e0cc-5996-4060-aa28-d24a536e799f\") " pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.577744 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.577724    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzkcc\" (UniqueName: \"kubernetes.io/projected/a403e860-0e0a-4068-bbf7-e9eec044085e-kube-api-access-fzkcc\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:50.577979 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.577960    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfnvf\" (UniqueName: \"kubernetes.io/projected/26c0e0cc-5996-4060-aa28-d24a536e799f-kube-api-access-vfnvf\") pod \"ingress-canary-kz47p\" (UID: \"26c0e0cc-5996-4060-aa28-d24a536e799f\") " pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.697073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.697039    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kz47p"
Sep 11 12:47:50.985037 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:50.984750    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kz47p"]
Sep 11 12:47:50.989459 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:47:50.989434    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c0e0cc_5996_4060_aa28_d24a536e799f.slice/crio-3b5c3184916e737e4fdcecb928119aed2abb015115d52349a787b2c6af464db1 WatchSource:0}: Error finding container 3b5c3184916e737e4fdcecb928119aed2abb015115d52349a787b2c6af464db1: Status 404 returned error can't find the container with id 3b5c3184916e737e4fdcecb928119aed2abb015115d52349a787b2c6af464db1
Sep 11 12:47:51.071497 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.071469    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:51.071696 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:51.071675    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:51.071761 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:51.071737    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:47:52.071721886 +0000 UTC m=+36.451247824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:51.133608 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.133575    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:47:51.133771 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.133575    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:47:51.133979 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.133586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:47:51.136352 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.136176    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:47:51.136352 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.136241    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:47:51.136686 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.136555    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:47:51.136686 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.136587    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kdd4\""
Sep 11 12:47:51.136686 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.136604    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:47:51.136686 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.136636    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86zcf\""
Sep 11 12:47:51.470918 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:51.470882    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kz47p" event={"ID":"26c0e0cc-5996-4060-aa28-d24a536e799f","Type":"ContainerStarted","Data":"3b5c3184916e737e4fdcecb928119aed2abb015115d52349a787b2c6af464db1"}
Sep 11 12:47:52.078147 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:52.078103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:52.078352 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:52.078269    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:52.078413 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:52.078366    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:47:54.07834708 +0000 UTC m=+38.457872994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:53.479861 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:53.479826    2572 generic.go:356] "Generic (PLEG): container finished" podID="ee68c729-1d1d-45d5-b526-e1f0710035fa" containerID="0c193e75251ef08037057fb11ae702f7269be4ec3d667df19d5d4092278e9b84" exitCode=0
Sep 11 12:47:53.480579 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:53.479913    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerDied","Data":"0c193e75251ef08037057fb11ae702f7269be4ec3d667df19d5d4092278e9b84"}
Sep 11 12:47:54.094428 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:54.094385    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:54.094619 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:54.094550    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:54.094619 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:54.094617    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:47:58.094601876 +0000 UTC m=+42.474127790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:47:54.486763 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:54.486728    2572 generic.go:356] "Generic (PLEG): container finished" podID="ee68c729-1d1d-45d5-b526-e1f0710035fa" containerID="d6d2d1e706295e811d89c722a21b3a2ce1bf716558fbc2ffbddaee2d92e63202" exitCode=0
Sep 11 12:47:54.487265 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:54.486777    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerDied","Data":"d6d2d1e706295e811d89c722a21b3a2ce1bf716558fbc2ffbddaee2d92e63202"}
Sep 11 12:47:55.491423 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:55.491179    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kz47p" event={"ID":"26c0e0cc-5996-4060-aa28-d24a536e799f","Type":"ContainerStarted","Data":"958cbd14145c3dbcacab3b24d4fc5e1e83cd071c72e4ef38f1135acdf404fe7b"}
Sep 11 12:47:55.494545 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:55.494520    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" event={"ID":"ee68c729-1d1d-45d5-b526-e1f0710035fa","Type":"ContainerStarted","Data":"a9a0719ccb3679c9fb81e16dfb491929ac22b9cf7bd6b8bd4fefadf0eecbe56c"}
Sep 11 12:47:55.505685 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:55.505650    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kz47p" podStartSLOduration=1.598999831 podStartE2EDuration="5.505638543s" totalImagesPullingTime="3.906638712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:55.505452736 +0000 UTC m=+39.884978672" watchObservedRunningTime="2026-09-11 12:47:55.505638543 +0000 UTC m=+39.885164478"
Sep 11 12:47:55.524503 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:55.524461    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bqhc5" podStartSLOduration=8.12464952 podStartE2EDuration="39.524447786s" totalImagesPullingTime="31.399798266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:47:55.523874993 +0000 UTC m=+39.903400942" watchObservedRunningTime="2026-09-11 12:47:55.524447786 +0000 UTC m=+39.903973719"
Sep 11 12:47:58.123240 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:47:58.123196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:47:58.123627 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:58.123375    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:47:58.123627 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:47:58.123443    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:48:06.12342699 +0000 UTC m=+50.502952904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:48:06.176390 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:06.176354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:48:06.176811 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:06.176496    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:48:06.176811 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:06.176559    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:48:22.176544373 +0000 UTC m=+66.556070286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:48:16.466712 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:16.466675    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cl228"
Sep 11 12:48:20.779312 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.779279    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:48:20.781732 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.781713    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:48:20.792426 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.792403    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:48:20.804215 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.804184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccj7z\" (UniqueName: \"kubernetes.io/projected/5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4-kube-api-access-ccj7z\") pod \"network-check-target-9znrk\" (UID: \"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4\") " pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:48:20.854131 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.854107    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kdd4\""
Sep 11 12:48:20.862952 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.862924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:48:20.880532 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.880505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:48:20.880637 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.880550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:48:20.882683 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.882648    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:48:20.882787 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.882771    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:48:20.891636 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:20.891615    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:48:20.891721 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:20.891674    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:49:24.891658533 +0000 UTC m=+129.271184447 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : secret "metrics-daemon-secret" not found
Sep 11 12:48:20.893852 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:20.893826    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71-original-pull-secret\") pod \"global-pull-secret-syncer-stvxq\" (UID: \"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71\") " pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:48:21.130112 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:21.130044    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9znrk"]
Sep 11 12:48:21.133647 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:48:21.133622    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b21a7a1_70cc_439e_9c0f_d1ff5767d8e4.slice/crio-23a9cc068a1c6c7821c793af04a9aa630482db76440c54a4b62f892707112832 WatchSource:0}: Error finding container 23a9cc068a1c6c7821c793af04a9aa630482db76440c54a4b62f892707112832: Status 404 returned error can't find the container with id 23a9cc068a1c6c7821c793af04a9aa630482db76440c54a4b62f892707112832
Sep 11 12:48:21.157128 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:21.157103    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stvxq"
Sep 11 12:48:21.421012 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:21.420962    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stvxq"]
Sep 11 12:48:21.425371 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:48:21.425346    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff9a6d3_53c7_4c74_a2c0_1aa58b2aba71.slice/crio-c0d929910982844f5aa835b3784abef3740eb640e3ed97134ee64f73fca1ab8b WatchSource:0}: Error finding container c0d929910982844f5aa835b3784abef3740eb640e3ed97134ee64f73fca1ab8b: Status 404 returned error can't find the container with id c0d929910982844f5aa835b3784abef3740eb640e3ed97134ee64f73fca1ab8b
Sep 11 12:48:21.556494 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:21.556452    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stvxq" event={"ID":"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71","Type":"ContainerStarted","Data":"c0d929910982844f5aa835b3784abef3740eb640e3ed97134ee64f73fca1ab8b"}
Sep 11 12:48:21.557608 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:21.557588    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9znrk" event={"ID":"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4","Type":"ContainerStarted","Data":"23a9cc068a1c6c7821c793af04a9aa630482db76440c54a4b62f892707112832"}
Sep 11 12:48:22.189286 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:22.189250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:48:22.189789 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:22.189394    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:48:22.189789 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:22.189455    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:48:54.189438779 +0000 UTC m=+98.568964692 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:48:26.572740 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.572700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stvxq" event={"ID":"2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71","Type":"ContainerStarted","Data":"b454144bf1fe7339b45e2736d3cf69da1b8211a84d16e2e639df06bbb952078b"}
Sep 11 12:48:26.574247 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.574225    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9znrk" event={"ID":"5b21a7a1-70cc-439e-9c0f-d1ff5767d8e4","Type":"ContainerStarted","Data":"e56d42e0bf966c6e43ce905f2a2e981ba7e12bcf6c138f35a4922989902006b6"}
Sep 11 12:48:26.574390 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.574372    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:48:26.586753 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.586710    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-stvxq" podStartSLOduration=66.090230636 podStartE2EDuration="1m10.586698134s" totalImagesPullingTime="4.496467498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:48:26.586161769 +0000 UTC m=+70.965687707" watchObservedRunningTime="2026-09-11 12:48:26.586698134 +0000 UTC m=+70.966224069"
Sep 11 12:48:26.600651 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.600611    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9znrk" podStartSLOduration=65.817246671 podStartE2EDuration="1m10.600599776s" totalImagesPullingTime="4.783353105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:48:26.600077897 +0000 UTC m=+70.979603827" watchObservedRunningTime="2026-09-11 12:48:26.600599776 +0000 UTC m=+70.980125737"
Sep 11 12:48:26.736897 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.736870    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"]
Sep 11 12:48:26.739596 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.739581    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:26.741693 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.741672    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 12:48:26.742005 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.741988    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 12:48:26.742061 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.741988    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 12:48:26.742242 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.742230    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 12:48:26.750331 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.750287    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"]
Sep 11 12:48:26.778761 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.778733    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"]
Sep 11 12:48:26.781603 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.781589    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:26.783510 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.783487    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 12:48:26.783783 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.783768    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 12:48:26.783957 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.783937    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 12:48:26.784073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.783965    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 12:48:26.793569 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.793550    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"]
Sep 11 12:48:26.925117 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925082    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfmsr\" (UniqueName: \"kubernetes.io/projected/e4619977-b752-4f81-bc95-43d1d45efe94-kube-api-access-hfmsr\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:26.925277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925137    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkvxx\" (UniqueName: \"kubernetes.io/projected/2d70c934-26bf-400c-8446-f75e24677313-kube-api-access-dkvxx\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:26.925277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925164    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4619977-b752-4f81-bc95-43d1d45efe94-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:26.925277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-ca\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:26.925277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4619977-b752-4f81-bc95-43d1d45efe94-tmp\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:26.925277 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925268    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d70c934-26bf-400c-8446-f75e24677313-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:26.925465 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:26.925465 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925303    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-hub\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:26.925465 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:26.925337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.025925 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.025878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfmsr\" (UniqueName: \"kubernetes.io/projected/e4619977-b752-4f81-bc95-43d1d45efe94-kube-api-access-hfmsr\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:27.025925 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.025938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkvxx\" (UniqueName: \"kubernetes.io/projected/2d70c934-26bf-400c-8446-f75e24677313-kube-api-access-dkvxx\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.026189 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4619977-b752-4f81-bc95-43d1d45efe94-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:27.026189 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-ca\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.026189 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026106    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4619977-b752-4f81-bc95-43d1d45efe94-tmp\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:27.026189 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d70c934-26bf-400c-8446-f75e24677313-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.026189 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.026470 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026203    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-hub\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.026470 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026231    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.026637 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.026606    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4619977-b752-4f81-bc95-43d1d45efe94-tmp\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:27.027128 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.027101    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d70c934-26bf-400c-8446-f75e24677313-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.028813 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.028781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-ca\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.028916 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.028884    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.028974 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.028931    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4619977-b752-4f81-bc95-43d1d45efe94-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:27.029280 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.029262    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-hub\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.029337 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.029269    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d70c934-26bf-400c-8446-f75e24677313-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.033111 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.033085    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfmsr\" (UniqueName: \"kubernetes.io/projected/e4619977-b752-4f81-bc95-43d1d45efe94-kube-api-access-hfmsr\") pod \"klusterlet-addon-workmgr-54bcb59b77-88874\" (UID: \"e4619977-b752-4f81-bc95-43d1d45efe94\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:27.033189 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.033138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkvxx\" (UniqueName: \"kubernetes.io/projected/2d70c934-26bf-400c-8446-f75e24677313-kube-api-access-dkvxx\") pod \"cluster-proxy-proxy-agent-84fff94cf9-d8tsz\" (UID: \"2d70c934-26bf-400c-8446-f75e24677313\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.048037 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.048013    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:27.098505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.098484    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:48:27.317667 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.317588    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"]
Sep 11 12:48:27.321049 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:48:27.321023    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4619977_b752_4f81_bc95_43d1d45efe94.slice/crio-b216a96d04d1f3820c2c8300495614908af713e8bb13e9dc82ca2b351a0dce4f WatchSource:0}: Error finding container b216a96d04d1f3820c2c8300495614908af713e8bb13e9dc82ca2b351a0dce4f: Status 404 returned error can't find the container with id b216a96d04d1f3820c2c8300495614908af713e8bb13e9dc82ca2b351a0dce4f
Sep 11 12:48:27.376842 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.376810    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"]
Sep 11 12:48:27.381176 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:48:27.381150    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d70c934_26bf_400c_8446_f75e24677313.slice/crio-e3d784c2581ec24aa36917a5e0d111a45f24f336582c2aa7e19219784996f95c WatchSource:0}: Error finding container e3d784c2581ec24aa36917a5e0d111a45f24f336582c2aa7e19219784996f95c: Status 404 returned error can't find the container with id e3d784c2581ec24aa36917a5e0d111a45f24f336582c2aa7e19219784996f95c
Sep 11 12:48:27.578188 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.578111    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" event={"ID":"2d70c934-26bf-400c-8446-f75e24677313","Type":"ContainerStarted","Data":"e3d784c2581ec24aa36917a5e0d111a45f24f336582c2aa7e19219784996f95c"}
Sep 11 12:48:27.579290 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:27.579258    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874" event={"ID":"e4619977-b752-4f81-bc95-43d1d45efe94","Type":"ContainerStarted","Data":"b216a96d04d1f3820c2c8300495614908af713e8bb13e9dc82ca2b351a0dce4f"}
Sep 11 12:48:33.599289 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.599252    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" event={"ID":"2d70c934-26bf-400c-8446-f75e24677313","Type":"ContainerStarted","Data":"32126dedc446dacc21833641a9c8f23826d9c565ad1fb1106feec24eadcac34f"}
Sep 11 12:48:33.599769 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.599299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" event={"ID":"2d70c934-26bf-400c-8446-f75e24677313","Type":"ContainerStarted","Data":"eb550c43f54a184af7c218d43ac598c5b27863d1b15f7bb27fc063600c22900e"}
Sep 11 12:48:33.599769 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.599337    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" event={"ID":"2d70c934-26bf-400c-8446-f75e24677313","Type":"ContainerStarted","Data":"5436b7a13d0616e20bf222b059a61af8bfde31593c502ca5067062aa6f2b5e2c"}
Sep 11 12:48:33.600839 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.600815    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874" event={"ID":"e4619977-b752-4f81-bc95-43d1d45efe94","Type":"ContainerStarted","Data":"78984febc4a5655402cfcd25f1616acef0b511c3f6354ea21476a95ed3e03e87"}
Sep 11 12:48:33.600938 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.600883    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:33.602692 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.602673    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:48:33.618830 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.618783    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" podStartSLOduration=1.9557831289999998 podStartE2EDuration="7.618766321s" totalImagesPullingTime="5.662983192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:48:33.617460573 +0000 UTC m=+77.996986509" watchObservedRunningTime="2026-09-11 12:48:33.618766321 +0000 UTC m=+77.998292258"
Sep 11 12:48:33.630957 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:33.630921    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874" podStartSLOduration=1.902876444 podStartE2EDuration="7.630909583s" totalImagesPullingTime="5.728033139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:48:33.630839693 +0000 UTC m=+78.010365637" watchObservedRunningTime="2026-09-11 12:48:33.630909583 +0000 UTC m=+78.010435518"
Sep 11 12:48:54.213818 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:54.213773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:48:54.214281 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:54.213876    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:48:54.214281 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:48:54.213950    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:49:58.213928467 +0000 UTC m=+162.593454380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:48:57.581854 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:48:57.581824    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9znrk"
Sep 11 12:49:24.914291 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:49:24.914247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:49:24.914770 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:49:24.914426    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:49:24.914770 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:49:24.914504    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:51:26.914486618 +0000 UTC m=+251.294012535 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : secret "metrics-daemon-secret" not found
Sep 11 12:49:53.391369 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:49:53.391307    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wcmgr" podUID="a403e860-0e0a-4068-bbf7-e9eec044085e"
Sep 11 12:49:53.824237 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:49:53.824207    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:49:54.145085 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:49:54.145052    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:49:58.244240 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:49:58.244190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:49:58.244774 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:49:58.244354    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:49:58.244774 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:49:58.244426    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls podName:a403e860-0e0a-4068-bbf7-e9eec044085e nodeName:}" failed. No retries permitted until 2026-09-11 12:52:00.244404856 +0000 UTC m=+284.623930792 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls") pod "dns-default-wcmgr" (UID: "a403e860-0e0a-4068-bbf7-e9eec044085e") : secret "dns-default-metrics-tls" not found
Sep 11 12:50:05.133964 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:05.133926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:50:33.601879 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:33.601764    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874" podUID="e4619977-b752-4f81-bc95-43d1d45efe94" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Sep 11 12:50:33.936893 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:33.936859    2572 generic.go:356] "Generic (PLEG): container finished" podID="e4619977-b752-4f81-bc95-43d1d45efe94" containerID="78984febc4a5655402cfcd25f1616acef0b511c3f6354ea21476a95ed3e03e87" exitCode=1
Sep 11 12:50:33.937056 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:33.936910    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874" event={"ID":"e4619977-b752-4f81-bc95-43d1d45efe94","Type":"ContainerDied","Data":"78984febc4a5655402cfcd25f1616acef0b511c3f6354ea21476a95ed3e03e87"}
Sep 11 12:50:33.937197 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:33.937184    2572 scope.go:117] "RemoveContainer" containerID="78984febc4a5655402cfcd25f1616acef0b511c3f6354ea21476a95ed3e03e87"
Sep 11 12:50:34.941762 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:34.941727    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874" event={"ID":"e4619977-b752-4f81-bc95-43d1d45efe94","Type":"ContainerStarted","Data":"c1d6e8a6b3325e9db498e77233ae3e5aaf6404c4515089618fbf74a743fb354d"}
Sep 11 12:50:34.942176 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:34.942040    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:50:34.942642 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:50:34.942623    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bcb59b77-88874"
Sep 11 12:51:25.154541 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.154508    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6t94l"]
Sep 11 12:51:25.156435 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.156416    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.172293 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.172276    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 12:51:25.172997 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.172908    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 12:51:25.172997 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.172926    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 12:51:25.173159 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.172991    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqv5f\""
Sep 11 12:51:25.176412 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.174131    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 12:51:25.193768 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.193746    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6t94l"]
Sep 11 12:51:25.238842 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.238818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.238940 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.238847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f8ms\" (UniqueName: \"kubernetes.io/projected/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-api-access-2f8ms\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.238940 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.238874    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.239027 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.238942    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1aea23f-19ba-4872-b2f2-ca158db6e92c-crio-socket\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.239027 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.238976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1aea23f-19ba-4872-b2f2-ca158db6e92c-data-volume\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.339276 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.339233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.339276 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.339277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f8ms\" (UniqueName: \"kubernetes.io/projected/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-api-access-2f8ms\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.339521 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.339313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.339521 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.339396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1aea23f-19ba-4872-b2f2-ca158db6e92c-crio-socket\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.339521 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.339400    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:25.339521 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.339422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1aea23f-19ba-4872-b2f2-ca158db6e92c-data-volume\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.339521 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.339463    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:25.839447382 +0000 UTC m=+250.218973300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:25.339521 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.339463    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.339521 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.339497    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1aea23f-19ba-4872-b2f2-ca158db6e92c-crio-socket\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.339867 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.339539    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:25.83952164 +0000 UTC m=+250.219047577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.339867 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.339766    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1aea23f-19ba-4872-b2f2-ca158db6e92c-data-volume\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.353424 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.353398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f8ms\" (UniqueName: \"kubernetes.io/projected/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-api-access-2f8ms\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.843104 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.843066    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.843298 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:25.843118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:25.843298 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.843198    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.843298 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.843209    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:25.843298 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.843272    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:26.843253817 +0000 UTC m=+251.222779736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:25.843298 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:25.843288    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:26.843280884 +0000 UTC m=+251.222806800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:26.850468 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:26.850415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:26.850870 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:26.850522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:26.850870 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:26.850536    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:26.850870 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:26.850593    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:28.850579259 +0000 UTC m=+253.230105172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:26.850870 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:26.850616    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:26.850870 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:26.850665    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:28.850649311 +0000 UTC m=+253.230175246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:26.942648 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:26.942622    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sw2tq_73599d33-dd5d-449d-9d91-d2f315faa922/dns-node-resolver/0.log"
Sep 11 12:51:26.950884 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:26.950865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:51:26.951037 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:26.951024    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:51:26.951093 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:26.951084    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs podName:3678675e-a199-4e06-9951-1a3f01f03feb nodeName:}" failed. No retries permitted until 2026-09-11 12:53:28.95107047 +0000 UTC m=+373.330596385 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs") pod "network-metrics-daemon-c2d6c" (UID: "3678675e-a199-4e06-9951-1a3f01f03feb") : secret "metrics-daemon-secret" not found
Sep 11 12:51:27.944973 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:27.944948    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w74bf_be1e7525-a81d-417f-ae9c-2511993d3d86/node-ca/0.log"
Sep 11 12:51:28.744420 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:28.744393    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kz47p_26c0e0cc-5996-4060-aa28-d24a536e799f/serve-healthcheck-canary/0.log"
Sep 11 12:51:28.865396 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:28.865366    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:28.865542 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:28.865429    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:28.865542 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:28.865484    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:28.865542 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:28.865526    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:28.865648 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:28.865549    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:32.865534982 +0000 UTC m=+257.245060901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:28.865648 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:28.865567    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:32.865554894 +0000 UTC m=+257.245080809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:32.894526 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:32.894485    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:32.895029 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:32.894537    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:32.895029 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:32.894626    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:51:32.895029 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:32.894649    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:32.895029 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:32.894693    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:40.894674654 +0000 UTC m=+265.274200570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : configmap "kube-rbac-proxy" not found
Sep 11 12:51:32.895029 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:32.894707    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:40.894701012 +0000 UTC m=+265.274226926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:40.957654 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:40.957543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:40.957654 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:40.957607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:40.958263 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:40.957724    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:40.958263 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:40.957812    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls podName:a1aea23f-19ba-4872-b2f2-ca158db6e92c nodeName:}" failed. No retries permitted until 2026-09-11 12:51:56.957789057 +0000 UTC m=+281.337314973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6t94l" (UID: "a1aea23f-19ba-4872-b2f2-ca158db6e92c") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:51:40.958263 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:40.958079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1aea23f-19ba-4872-b2f2-ca158db6e92c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:56.824964 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:51:56.824900    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wcmgr" podUID="a403e860-0e0a-4068-bbf7-e9eec044085e"
Sep 11 12:51:56.977401 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:56.977363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:56.979884 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:56.979861    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1aea23f-19ba-4872-b2f2-ca158db6e92c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6t94l\" (UID: \"a1aea23f-19ba-4872-b2f2-ca158db6e92c\") " pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:57.170928 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:57.170901    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:51:57.264890 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:57.264849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6t94l"
Sep 11 12:51:57.542409 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:57.542289    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6t94l"]
Sep 11 12:51:57.546462 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:51:57.546435    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1aea23f_19ba_4872_b2f2_ca158db6e92c.slice/crio-a98911ce6807377b497634d54df124ff7c65c1d460811fabc52d3ea971fbf5a3 WatchSource:0}: Error finding container a98911ce6807377b497634d54df124ff7c65c1d460811fabc52d3ea971fbf5a3: Status 404 returned error can't find the container with id a98911ce6807377b497634d54df124ff7c65c1d460811fabc52d3ea971fbf5a3
Sep 11 12:51:58.175543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:58.175506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t94l" event={"ID":"a1aea23f-19ba-4872-b2f2-ca158db6e92c","Type":"ContainerStarted","Data":"e00a74df7902b6c9687e634f1aa06465ed4c4b99ee80acf667ccab6c2a499705"}
Sep 11 12:51:58.176052 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:58.175564    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t94l" event={"ID":"a1aea23f-19ba-4872-b2f2-ca158db6e92c","Type":"ContainerStarted","Data":"a98911ce6807377b497634d54df124ff7c65c1d460811fabc52d3ea971fbf5a3"}
Sep 11 12:51:59.181090 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:51:59.181056    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t94l" event={"ID":"a1aea23f-19ba-4872-b2f2-ca158db6e92c","Type":"ContainerStarted","Data":"6a38573418ea410fc5f8e44219084a3d20214a7d013e811c0e30e33c9c174865"}
Sep 11 12:52:00.186301 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:00.186267    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6t94l" event={"ID":"a1aea23f-19ba-4872-b2f2-ca158db6e92c","Type":"ContainerStarted","Data":"807233a73bc47ccac7f7695867fcb40b8054b5dcdd2ae1e74daec4bc998f2042"}
Sep 11 12:52:00.203483 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:00.203441    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6t94l" podStartSLOduration=33.108157911 podStartE2EDuration="35.203427701s" totalImagesPullingTime="2.09526979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:51:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:00.202772032 +0000 UTC m=+284.582297972" watchObservedRunningTime="2026-09-11 12:52:00.203427701 +0000 UTC m=+284.582953637"
Sep 11 12:52:00.300781 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:00.300754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:52:00.303236 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:00.303208    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a403e860-0e0a-4068-bbf7-e9eec044085e-metrics-tls\") pod \"dns-default-wcmgr\" (UID: \"a403e860-0e0a-4068-bbf7-e9eec044085e\") " pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:52:00.474167 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:00.474086    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2v8d4\""
Sep 11 12:52:00.482807 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:00.482791    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:52:00.751662 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:00.751580    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wcmgr"]
Sep 11 12:52:00.756836 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:52:00.756787    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda403e860_0e0a_4068_bbf7_e9eec044085e.slice/crio-77f5093815228561558905ef4b8a175411ab5d225163912c78f47e118cd4cee4 WatchSource:0}: Error finding container 77f5093815228561558905ef4b8a175411ab5d225163912c78f47e118cd4cee4: Status 404 returned error can't find the container with id 77f5093815228561558905ef4b8a175411ab5d225163912c78f47e118cd4cee4
Sep 11 12:52:01.190074 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:01.190030    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcmgr" event={"ID":"a403e860-0e0a-4068-bbf7-e9eec044085e","Type":"ContainerStarted","Data":"77f5093815228561558905ef4b8a175411ab5d225163912c78f47e118cd4cee4"}
Sep 11 12:52:02.356858 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.356818    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kgwz2"]
Sep 11 12:52:02.359878 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.359851    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.363393 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.363349    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 12:52:02.363393 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.363371    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 12:52:02.363604 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.363420    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 12:52:02.363712 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.363692    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 12:52:02.363839 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.363747    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 12:52:02.363949 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.363933    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8ttnf\""
Sep 11 12:52:02.364569 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.364552    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 12:52:02.418383 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-wtmp\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418580 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418438    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-textfile\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418580 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418580 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-tls\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418580 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418516    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-root\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418580 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d831b4-e0d3-4241-9d57-234343162b1c-metrics-client-ca\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418836 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-sys\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418836 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.418836 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.418686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g69lq\" (UniqueName: \"kubernetes.io/projected/d4d831b4-e0d3-4241-9d57-234343162b1c-kube-api-access-g69lq\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520257 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-textfile\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520257 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-tls\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-root\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d831b4-e0d3-4241-9d57-234343162b1c-metrics-client-ca\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-sys\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520441    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g69lq\" (UniqueName: \"kubernetes.io/projected/d4d831b4-e0d3-4241-9d57-234343162b1c-kube-api-access-g69lq\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520543 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-wtmp\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520867 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-wtmp\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520867 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520753    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-sys\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.520867 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520846    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4d831b4-e0d3-4241-9d57-234343162b1c-root\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.521015 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.520977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-textfile\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.521374 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.521303    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d831b4-e0d3-4241-9d57-234343162b1c-metrics-client-ca\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.521374 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.521336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.524401 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.524379    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-tls\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.524520 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.524421    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4d831b4-e0d3-4241-9d57-234343162b1c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.531110 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.531081    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g69lq\" (UniqueName: \"kubernetes.io/projected/d4d831b4-e0d3-4241-9d57-234343162b1c-kube-api-access-g69lq\") pod \"node-exporter-kgwz2\" (UID: \"d4d831b4-e0d3-4241-9d57-234343162b1c\") " pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.669863 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:02.669833    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kgwz2"
Sep 11 12:52:02.679760 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:52:02.679729    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d831b4_e0d3_4241_9d57_234343162b1c.slice/crio-1dfdb4e786ac54f742eff609373127d6181397a43c0c5976562c4cc8bd21cd3b WatchSource:0}: Error finding container 1dfdb4e786ac54f742eff609373127d6181397a43c0c5976562c4cc8bd21cd3b: Status 404 returned error can't find the container with id 1dfdb4e786ac54f742eff609373127d6181397a43c0c5976562c4cc8bd21cd3b
Sep 11 12:52:03.199693 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:03.199656    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcmgr" event={"ID":"a403e860-0e0a-4068-bbf7-e9eec044085e","Type":"ContainerStarted","Data":"e229f9539a9aa7805b2cf872f13630bb34e98c765d445bfff24dbee734002ffd"}
Sep 11 12:52:03.199904 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:03.199729    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wcmgr" event={"ID":"a403e860-0e0a-4068-bbf7-e9eec044085e","Type":"ContainerStarted","Data":"57c11c980a713a43e445a62a5bfdd8a1879a2d8dc3b5434449c3b3dc34fada65"}
Sep 11 12:52:03.199904 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:03.199763    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:52:03.200891 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:03.200870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgwz2" event={"ID":"d4d831b4-e0d3-4241-9d57-234343162b1c","Type":"ContainerStarted","Data":"1dfdb4e786ac54f742eff609373127d6181397a43c0c5976562c4cc8bd21cd3b"}
Sep 11 12:52:03.217716 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:03.217663    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wcmgr" podStartSLOduration=251.598936447 podStartE2EDuration="4m13.217642035s" totalImagesPullingTime="1.618705588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:03.216693032 +0000 UTC m=+287.596218980" watchObservedRunningTime="2026-09-11 12:52:03.217642035 +0000 UTC m=+287.597167976"
Sep 11 12:52:04.205088 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:04.205051    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4d831b4-e0d3-4241-9d57-234343162b1c" containerID="641c6296bede918f9722d96ca70f11b34d89cc75b63d3dfda22fefb0fb50c7c0" exitCode=0
Sep 11 12:52:04.205480 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:04.205142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgwz2" event={"ID":"d4d831b4-e0d3-4241-9d57-234343162b1c","Type":"ContainerDied","Data":"641c6296bede918f9722d96ca70f11b34d89cc75b63d3dfda22fefb0fb50c7c0"}
Sep 11 12:52:05.209918 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.209881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgwz2" event={"ID":"d4d831b4-e0d3-4241-9d57-234343162b1c","Type":"ContainerStarted","Data":"d46b9cbba977d7bce7834af9794b466de87c0f40b64be2afe2306c255cc304a7"}
Sep 11 12:52:05.210310 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.209930    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgwz2" event={"ID":"d4d831b4-e0d3-4241-9d57-234343162b1c","Type":"ContainerStarted","Data":"f4d41a1e2cd7bdb4394c64fcec1fd859fd4c7d8b70683f355bcf3e46bb1ae185"}
Sep 11 12:52:05.242783 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.242736    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kgwz2" podStartSLOduration=2.328557986 podStartE2EDuration="3.242720997s" totalImagesPullingTime="842.041526ms" totalInitContainerRuntime="72.121485ms" isStatefulPod=true podCreationTimestamp="2026-09-11 12:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:05.241557322 +0000 UTC m=+289.621083259" watchObservedRunningTime="2026-09-11 12:52:05.242720997 +0000 UTC m=+289.622246933"
Sep 11 12:52:05.789932 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.789897    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-kk6zt"]
Sep 11 12:52:05.792909 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.792893    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-kk6zt"
Sep 11 12:52:05.795416 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.795394    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 12:52:05.795519 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.795425    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vl87d\""
Sep 11 12:52:05.795519 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.795482    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 12:52:05.803428 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.803407    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-kk6zt"]
Sep 11 12:52:05.844297 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.844261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g68s\" (UniqueName: \"kubernetes.io/projected/e012d3d5-8838-4243-a364-3f664f0835f7-kube-api-access-4g68s\") pod \"downloads-76f99584f4-kk6zt\" (UID: \"e012d3d5-8838-4243-a364-3f664f0835f7\") " pod="openshift-console/downloads-76f99584f4-kk6zt"
Sep 11 12:52:05.945048 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.945019    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g68s\" (UniqueName: \"kubernetes.io/projected/e012d3d5-8838-4243-a364-3f664f0835f7-kube-api-access-4g68s\") pod \"downloads-76f99584f4-kk6zt\" (UID: \"e012d3d5-8838-4243-a364-3f664f0835f7\") " pod="openshift-console/downloads-76f99584f4-kk6zt"
Sep 11 12:52:05.954158 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:05.954124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g68s\" (UniqueName: \"kubernetes.io/projected/e012d3d5-8838-4243-a364-3f664f0835f7-kube-api-access-4g68s\") pod \"downloads-76f99584f4-kk6zt\" (UID: \"e012d3d5-8838-4243-a364-3f664f0835f7\") " pod="openshift-console/downloads-76f99584f4-kk6zt"
Sep 11 12:52:06.101764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.101660    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-kk6zt"
Sep 11 12:52:06.385466 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.385390    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-kk6zt"]
Sep 11 12:52:06.388718 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:52:06.388691    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode012d3d5_8838_4243_a364_3f664f0835f7.slice/crio-805f82871acf573164524f1b8f7c2a414adf6699ec008372da290f22f9ae2c8d WatchSource:0}: Error finding container 805f82871acf573164524f1b8f7c2a414adf6699ec008372da290f22f9ae2c8d: Status 404 returned error can't find the container with id 805f82871acf573164524f1b8f7c2a414adf6699ec008372da290f22f9ae2c8d
Sep 11 12:52:06.840683 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.840648    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"]
Sep 11 12:52:06.843751 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.843731    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.846019 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.846001    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 12:52:06.846800 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.846773    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-drisnfhs7vbdb\""
Sep 11 12:52:06.846891 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.846799    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ghs27\""
Sep 11 12:52:06.846891 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.846799    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 12:52:06.846891 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.846852    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 12:52:06.846891 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.846857    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 12:52:06.851787 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.851771    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpp54\" (UniqueName: \"kubernetes.io/projected/71d0f046-150d-425d-aac7-3119a7d374b1-kube-api-access-rpp54\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.851880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.851800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/71d0f046-150d-425d-aac7-3119a7d374b1-metrics-server-audit-profiles\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.851880 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.851832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d0f046-150d-425d-aac7-3119a7d374b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.851968 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.851924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/71d0f046-150d-425d-aac7-3119a7d374b1-audit-log\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.852024 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.852009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-client-ca-bundle\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.852104 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.852044    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-secret-metrics-server-client-certs\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.852104 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.852066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-secret-metrics-server-tls\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.854216 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.854197    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"]
Sep 11 12:52:06.952634 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.952598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/71d0f046-150d-425d-aac7-3119a7d374b1-audit-log\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.952781 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.952644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-client-ca-bundle\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.952781 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.952675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-secret-metrics-server-client-certs\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.952781 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.952704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-secret-metrics-server-tls\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.952781 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.952729    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpp54\" (UniqueName: \"kubernetes.io/projected/71d0f046-150d-425d-aac7-3119a7d374b1-kube-api-access-rpp54\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.952781 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.952754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/71d0f046-150d-425d-aac7-3119a7d374b1-metrics-server-audit-profiles\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.953097 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.952784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d0f046-150d-425d-aac7-3119a7d374b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.953097 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.953007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/71d0f046-150d-425d-aac7-3119a7d374b1-audit-log\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.953744 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.953719    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/71d0f046-150d-425d-aac7-3119a7d374b1-metrics-server-audit-profiles\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.953872 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.953795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d0f046-150d-425d-aac7-3119a7d374b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.955286 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.955264    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-secret-metrics-server-tls\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.955423 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.955385    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-client-ca-bundle\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.955528 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.955510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/71d0f046-150d-425d-aac7-3119a7d374b1-secret-metrics-server-client-certs\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:06.962939 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:06.962916    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpp54\" (UniqueName: \"kubernetes.io/projected/71d0f046-150d-425d-aac7-3119a7d374b1-kube-api-access-rpp54\") pod \"metrics-server-8bbb5c54f-jvr9p\" (UID: \"71d0f046-150d-425d-aac7-3119a7d374b1\") " pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:07.058800 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.058764    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"]
Sep 11 12:52:07.063092 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.063066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.065157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.065123    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 12:52:07.065463 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.065447    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tw7kb\""
Sep 11 12:52:07.072337 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.072287    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"]
Sep 11 12:52:07.152404 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.152370    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:07.154641 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.154605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-7kv8g\" (UID: \"4236b3a2-1341-41bc-b94e-e556e4dbe9ec\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.154790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.154700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jzzt\" (UniqueName: \"kubernetes.io/projected/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-kube-api-access-6jzzt\") pod \"monitoring-plugin-5d85778b9d-7kv8g\" (UID: \"4236b3a2-1341-41bc-b94e-e556e4dbe9ec\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.221784 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.221717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-kk6zt" event={"ID":"e012d3d5-8838-4243-a364-3f664f0835f7","Type":"ContainerStarted","Data":"805f82871acf573164524f1b8f7c2a414adf6699ec008372da290f22f9ae2c8d"}
Sep 11 12:52:07.255439 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.255398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jzzt\" (UniqueName: \"kubernetes.io/projected/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-kube-api-access-6jzzt\") pod \"monitoring-plugin-5d85778b9d-7kv8g\" (UID: \"4236b3a2-1341-41bc-b94e-e556e4dbe9ec\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.255609 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.255503    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-7kv8g\" (UID: \"4236b3a2-1341-41bc-b94e-e556e4dbe9ec\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.255694 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:52:07.255652    2572 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 11 12:52:07.255742 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:52:07.255715    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-monitoring-plugin-cert podName:4236b3a2-1341-41bc-b94e-e556e4dbe9ec nodeName:}" failed. No retries permitted until 2026-09-11 12:52:07.755701122 +0000 UTC m=+292.135227036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-7kv8g" (UID: "4236b3a2-1341-41bc-b94e-e556e4dbe9ec") : secret "monitoring-plugin-cert" not found
Sep 11 12:52:07.265615 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.265587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jzzt\" (UniqueName: \"kubernetes.io/projected/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-kube-api-access-6jzzt\") pod \"monitoring-plugin-5d85778b9d-7kv8g\" (UID: \"4236b3a2-1341-41bc-b94e-e556e4dbe9ec\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.435550 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.435469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"]
Sep 11 12:52:07.439187 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:52:07.439160    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d0f046_150d_425d_aac7_3119a7d374b1.slice/crio-e6f10b35bc71756ba48b858021cff9c382ee8faebbae0ae92ba20836de79f5cf WatchSource:0}: Error finding container e6f10b35bc71756ba48b858021cff9c382ee8faebbae0ae92ba20836de79f5cf: Status 404 returned error can't find the container with id e6f10b35bc71756ba48b858021cff9c382ee8faebbae0ae92ba20836de79f5cf
Sep 11 12:52:07.759950 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.759862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-7kv8g\" (UID: \"4236b3a2-1341-41bc-b94e-e556e4dbe9ec\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.762652 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.762628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4236b3a2-1341-41bc-b94e-e556e4dbe9ec-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-7kv8g\" (UID: \"4236b3a2-1341-41bc-b94e-e556e4dbe9ec\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:07.975127 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:07.975094    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:08.134975 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:52:08.134934    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c2d6c" podUID="3678675e-a199-4e06-9951-1a3f01f03feb"
Sep 11 12:52:08.228606 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.228535    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p" event={"ID":"71d0f046-150d-425d-aac7-3119a7d374b1","Type":"ContainerStarted","Data":"e6f10b35bc71756ba48b858021cff9c382ee8faebbae0ae92ba20836de79f5cf"}
Sep 11 12:52:08.264844 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.264406    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"]
Sep 11 12:52:08.267774 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:52:08.267747    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4236b3a2_1341_41bc_b94e_e556e4dbe9ec.slice/crio-7145352b68cb8d71a88cd53e2639f693af730c2642f6f19ab658c5bf3e680713 WatchSource:0}: Error finding container 7145352b68cb8d71a88cd53e2639f693af730c2642f6f19ab658c5bf3e680713: Status 404 returned error can't find the container with id 7145352b68cb8d71a88cd53e2639f693af730c2642f6f19ab658c5bf3e680713
Sep 11 12:52:08.577723 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.577688    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:52:08.581991 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.581967    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.584428 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584344    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m55jm\""
Sep 11 12:52:08.584523 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584477    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 12:52:08.584523 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584498    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 12:52:08.584666 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584645    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 12:52:08.584844 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584825    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 12:52:08.584918 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584899    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 12:52:08.584971 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584955    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 12:52:08.585020 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.584998    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 12:52:08.585147 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.585129    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 12:52:08.585200 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.585159    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 12:52:08.585200 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.585195    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 12:52:08.585503 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.585482    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 12:52:08.585637 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.585621    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 12:52:08.585704 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.585658    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 12:52:08.585763 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.585622    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5bj8rhlu7nv4\""
Sep 11 12:52:08.587537 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.587517    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 12:52:08.604601 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.604578    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:52:08.668110 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668110 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668154    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668174    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-249fv\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-kube-api-access-249fv\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668246    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668272    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668311    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668368 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-config\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668601    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.668790 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.668652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769612 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769612 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769612 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769612 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769612 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769621    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769677    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769699    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769744    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769770    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-249fv\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-kube-api-access-249fv\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769849    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-config\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.769990 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.769981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.770611 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.770011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.770611 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.770039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.770611 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.770442    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.770771 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.770724    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.771309 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.771013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.773179 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.771689    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.773179 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.772356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.773179 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.772878    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.773179 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.772889    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.774236 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.774118    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.774974 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.774946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.775581 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.775554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.777033 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.776982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.777145 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.777130    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.777296 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.777229    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.777663 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.777617    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.777756 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.777685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-config\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.777756 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.777696    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.778869 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.778831    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.779444 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.779403    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.779915 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.779886    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.784540 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.784500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-249fv\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-kube-api-access-249fv\") pod \"prometheus-k8s-0\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:08.894920 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:08.894799    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:09.200725 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:09.200594    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:52:09.204464 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:52:09.204427    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3186a82_16e5_488f_85d7_00a217fefd07.slice/crio-28242d3b7695862e8777fe63bec2c8496e9f7e0cf4201cb80c0901afb786ea65 WatchSource:0}: Error finding container 28242d3b7695862e8777fe63bec2c8496e9f7e0cf4201cb80c0901afb786ea65: Status 404 returned error can't find the container with id 28242d3b7695862e8777fe63bec2c8496e9f7e0cf4201cb80c0901afb786ea65
Sep 11 12:52:09.241468 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:09.241429    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerStarted","Data":"28242d3b7695862e8777fe63bec2c8496e9f7e0cf4201cb80c0901afb786ea65"}
Sep 11 12:52:09.243653 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:09.243620    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p" event={"ID":"71d0f046-150d-425d-aac7-3119a7d374b1","Type":"ContainerStarted","Data":"3679c8a0ab1a68eb9c8351f53c6662efbcb49db7eb3cfc07ce6741192afba869"}
Sep 11 12:52:09.245333 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:09.245288    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g" event={"ID":"4236b3a2-1341-41bc-b94e-e556e4dbe9ec","Type":"ContainerStarted","Data":"7145352b68cb8d71a88cd53e2639f693af730c2642f6f19ab658c5bf3e680713"}
Sep 11 12:52:09.264530 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:09.264477    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p" podStartSLOduration=1.8182104190000001 podStartE2EDuration="3.264458038s" totalImagesPullingTime="1.446247619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:09.26303203 +0000 UTC m=+293.642557970" watchObservedRunningTime="2026-09-11 12:52:09.264458038 +0000 UTC m=+293.643983979"
Sep 11 12:52:10.251406 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:10.251268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g" event={"ID":"4236b3a2-1341-41bc-b94e-e556e4dbe9ec","Type":"ContainerStarted","Data":"ddd0d4e3435cc5cc417d99c0e963acc3ca2fbdd3c06c4b9816fa30e560812a00"}
Sep 11 12:52:10.267821 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:10.266992    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g" podStartSLOduration=1.604294698 podStartE2EDuration="3.266977722s" totalImagesPullingTime="1.662683024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:10.266086262 +0000 UTC m=+294.645612197" watchObservedRunningTime="2026-09-11 12:52:10.266977722 +0000 UTC m=+294.646503657"
Sep 11 12:52:11.256482 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:11.256444    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3186a82-16e5-488f-85d7-00a217fefd07" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4" exitCode=0
Sep 11 12:52:11.256928 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:11.256524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"}
Sep 11 12:52:11.257092 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:11.257070    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:11.263340 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:11.263305    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-7kv8g"
Sep 11 12:52:13.207662 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:13.207537    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wcmgr"
Sep 11 12:52:15.277839 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:15.277803    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerStarted","Data":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"}
Sep 11 12:52:15.278215 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:15.277886    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerStarted","Data":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"}
Sep 11 12:52:16.033606 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:16.033544    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:52:16.034125 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:16.034036    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:52:16.038646 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:16.038622    2572 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 12:52:17.100254 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:17.100212    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" podUID="2d70c934-26bf-400c-8446-f75e24677313" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 12:52:21.134012 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:21.133976    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:52:24.314602 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:24.314574    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-kk6zt" event={"ID":"e012d3d5-8838-4243-a364-3f664f0835f7","Type":"ContainerStarted","Data":"67c4c1dbb726d2198e885555a587a69044b1717ce0553d4dd951ce77ae199a37"}
Sep 11 12:52:24.314931 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:24.314858    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-kk6zt"
Sep 11 12:52:24.316743 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:24.316720    2572 patch_prober.go:28] interesting pod/downloads-76f99584f4-kk6zt container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused" start-of-body=
Sep 11 12:52:24.316848 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:24.316786    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-kk6zt" podUID="e012d3d5-8838-4243-a364-3f664f0835f7" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.11:8080/\": dial tcp 10.134.0.11:8080: connect: connection refused"
Sep 11 12:52:24.317736 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:24.317714    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerStarted","Data":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"}
Sep 11 12:52:24.331926 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:24.331877    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-kk6zt" podStartSLOduration=1.558165641 podStartE2EDuration="19.331861865s" totalImagesPullingTime="17.773696224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:24.33115212 +0000 UTC m=+308.710678055" watchObservedRunningTime="2026-09-11 12:52:24.331861865 +0000 UTC m=+308.711387803"
Sep 11 12:52:25.327030 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:25.326859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerStarted","Data":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"}
Sep 11 12:52:25.327030 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:25.326941    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerStarted","Data":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"}
Sep 11 12:52:25.327030 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:25.326973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerStarted","Data":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"}
Sep 11 12:52:25.343705 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:25.343679    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-kk6zt"
Sep 11 12:52:25.362067 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:25.362007    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.192891048 podStartE2EDuration="17.361986438s" totalImagesPullingTime="14.148190527s" totalInitContainerRuntime="20.904863ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:52:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:52:25.360492644 +0000 UTC m=+309.740018584" watchObservedRunningTime="2026-09-11 12:52:25.361986438 +0000 UTC m=+309.741512374"
Sep 11 12:52:27.099844 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:27.099804    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" podUID="2d70c934-26bf-400c-8446-f75e24677313" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 12:52:27.153229 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:27.153166    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:27.153459 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:27.153257    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:28.895463 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:28.895413    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:52:30.340487 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:30.340459    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kz47p_26c0e0cc-5996-4060-aa28-d24a536e799f/serve-healthcheck-canary/0.log"
Sep 11 12:52:37.100343 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:37.100281    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" podUID="2d70c934-26bf-400c-8446-f75e24677313" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 12:52:37.100800 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:37.100380    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz"
Sep 11 12:52:37.100897 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:37.100868    2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"32126dedc446dacc21833641a9c8f23826d9c565ad1fb1106feec24eadcac34f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 11 12:52:37.100934 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:37.100920    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" podUID="2d70c934-26bf-400c-8446-f75e24677313" containerName="service-proxy" containerID="cri-o://32126dedc446dacc21833641a9c8f23826d9c565ad1fb1106feec24eadcac34f" gracePeriod=30
Sep 11 12:52:37.377100 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:37.377011    2572 generic.go:356] "Generic (PLEG): container finished" podID="2d70c934-26bf-400c-8446-f75e24677313" containerID="32126dedc446dacc21833641a9c8f23826d9c565ad1fb1106feec24eadcac34f" exitCode=2
Sep 11 12:52:37.377100 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:37.377063    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" event={"ID":"2d70c934-26bf-400c-8446-f75e24677313","Type":"ContainerDied","Data":"32126dedc446dacc21833641a9c8f23826d9c565ad1fb1106feec24eadcac34f"}
Sep 11 12:52:37.377100 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:37.377101    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fff94cf9-d8tsz" event={"ID":"2d70c934-26bf-400c-8446-f75e24677313","Type":"ContainerStarted","Data":"f9a9be84c3668a4ea2038ba1d2ae721eed80de1560900d436e77df1758ec7aa9"}
Sep 11 12:52:47.158638 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:47.158607    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:52:47.162943 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:52:47.162920    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8bbb5c54f-jvr9p"
Sep 11 12:53:08.895957 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:08.895864    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:08.971674 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:08.971640    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:09.510473 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:09.510441    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:26.983646 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:26.983615    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:53:26.984201 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:26.983974    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="prometheus" containerID="cri-o://b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f" gracePeriod=600
Sep 11 12:53:26.984375 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:26.984352    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-thanos" containerID="cri-o://099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02" gracePeriod=600
Sep 11 12:53:26.984489 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:26.984460    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy" containerID="cri-o://0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b" gracePeriod=600
Sep 11 12:53:26.984623 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:26.984549    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="config-reloader" containerID="cri-o://8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03" gracePeriod=600
Sep 11 12:53:26.984623 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:26.984540    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="thanos-sidecar" containerID="cri-o://6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25" gracePeriod=600
Sep 11 12:53:26.984724 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:26.984540    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-web" containerID="cri-o://6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5" gracePeriod=600
Sep 11 12:53:27.231944 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.231915    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.371433 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371344    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-db\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371433 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371387    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371433 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371412    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-kubelet-serving-ca-bundle\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371435    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-1\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371486    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-thanos-prometheus-http-client-file\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371525    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-config-out\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371549    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-trusted-ca-bundle\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371582    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-web-config\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371608    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-metrics-client-ca\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371658    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-2\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371685    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-metrics-client-certs\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.371719 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371715    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-tls\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371737    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-tls-assets\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371762    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-config\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371785    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-0\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371810    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-249fv\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-kube-api-access-249fv\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371842    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-serving-certs-ca-bundle\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371872    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-kube-rbac-proxy\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371915    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-grpc-tls\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.372154 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371941    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f3186a82-16e5-488f-85d7-00a217fefd07\" (UID: \"f3186a82-16e5-488f-85d7-00a217fefd07\") "
Sep 11 12:53:27.373073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371780    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:27.373073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371894    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:27.373073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.371906    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:27.373073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.372139    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:27.373073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.372703    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:27.373073 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.372754    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:27.373478 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.373166    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:27.373531 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.373478    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:27.375438 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.375387    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.376032 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.376005    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.376124 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.376038    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.376711 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.376675    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.376807 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.376755    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.376807 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.376775    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-config" (OuterVolumeSpecName: "config") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.376903 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.376889    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:53:27.376975 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.376953    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-kube-api-access-249fv" (OuterVolumeSpecName: "kube-api-access-249fv") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "kube-api-access-249fv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:53:27.377192 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.377174    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-config-out" (OuterVolumeSpecName: "config-out") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:27.377256 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.377235    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.377620 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.377603    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.385686 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.385656    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-web-config" (OuterVolumeSpecName: "web-config") pod "f3186a82-16e5-488f-85d7-00a217fefd07" (UID: "f3186a82-16e5-488f-85d7-00a217fefd07"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:53:27.473388 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473358    2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473388 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473384    2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-config-out\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473388 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473394    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473403    2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-web-config\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473411    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-metrics-client-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473420    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473429    2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-metrics-client-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473438    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473446    2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-tls-assets\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473456    2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-config\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473463    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473471    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-249fv\" (UniqueName: \"kubernetes.io/projected/f3186a82-16e5-488f-85d7-00a217fefd07-kube-api-access-249fv\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473480    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473488    2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-kube-rbac-proxy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473496    2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-grpc-tls\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473505    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473514    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-db\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473522    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3186a82-16e5-488f-85d7-00a217fefd07-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473530    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.473599 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.473538    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3186a82-16e5-488f-85d7-00a217fefd07-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 12:53:27.566307 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566272    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3186a82-16e5-488f-85d7-00a217fefd07" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02" exitCode=0
Sep 11 12:53:27.566307 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566297    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3186a82-16e5-488f-85d7-00a217fefd07" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b" exitCode=0
Sep 11 12:53:27.566307 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566303    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3186a82-16e5-488f-85d7-00a217fefd07" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5" exitCode=0
Sep 11 12:53:27.566307 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566308    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3186a82-16e5-488f-85d7-00a217fefd07" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25" exitCode=0
Sep 11 12:53:27.566307 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566313    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3186a82-16e5-488f-85d7-00a217fefd07" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03" exitCode=0
Sep 11 12:53:27.566307 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566336    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3186a82-16e5-488f-85d7-00a217fefd07" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f" exitCode=0
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"}
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566386    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"}
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"}
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"}
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566559    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"}
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566583    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"}
Sep 11 12:53:27.566764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.566607    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3186a82-16e5-488f-85d7-00a217fefd07","Type":"ContainerDied","Data":"28242d3b7695862e8777fe63bec2c8496e9f7e0cf4201cb80c0901afb786ea65"}
Sep 11 12:53:27.567210 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.567163    2572 scope.go:117] "RemoveContainer" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.577582 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.577559    2572 scope.go:117] "RemoveContainer" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.584955 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.584934    2572 scope.go:117] "RemoveContainer" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.591803 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.591778    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:53:27.592644 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.592623    2572 scope.go:117] "RemoveContainer" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.595238 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.595212    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:53:27.600024 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.600005    2572 scope.go:117] "RemoveContainer" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.606918 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.606898    2572 scope.go:117] "RemoveContainer" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.614266 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.614246    2572 scope.go:117] "RemoveContainer" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.621022 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621001    2572 scope.go:117] "RemoveContainer" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.621380 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:53:27.621306    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": container with ID starting with 099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02 not found: ID does not exist" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.621459 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621388    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:53:27.621459 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621385    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"} err="failed to get container status \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": rpc error: code = NotFound desc = could not find container \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": container with ID starting with 099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02 not found: ID does not exist"
Sep 11 12:53:27.621459 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621407    2572 scope.go:117] "RemoveContainer" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.621633 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621620    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-web"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621634    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-web"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621641    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-thanos"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621648    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-thanos"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621655    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="prometheus"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621660    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="prometheus"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621667    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="init-config-reloader"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621673    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="init-config-reloader"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621679    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy"
Sep 11 12:53:27.621682 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621685    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:53:27.621668    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": container with ID starting with 0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b not found: ID does not exist" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621728    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"} err="failed to get container status \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": rpc error: code = NotFound desc = could not find container \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": container with ID starting with 0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b not found: ID does not exist"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621750    2572 scope.go:117] "RemoveContainer" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621701    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="config-reloader"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621785    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="config-reloader"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621792    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="thanos-sidecar"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621796    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="thanos-sidecar"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621837    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="prometheus"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621844    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-thanos"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621853    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621862    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="config-reloader"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621869    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="thanos-sidecar"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.621879    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" containerName="kube-rbac-proxy-web"
Sep 11 12:53:27.622006 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:53:27.621984    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": container with ID starting with 6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5 not found: ID does not exist" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.622493 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.622009    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"} err="failed to get container status \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": rpc error: code = NotFound desc = could not find container \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": container with ID starting with 6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5 not found: ID does not exist"
Sep 11 12:53:27.622493 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.622026    2572 scope.go:117] "RemoveContainer" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.622493 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:53:27.622252    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": container with ID starting with 6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25 not found: ID does not exist" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.622493 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.622269    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"} err="failed to get container status \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": rpc error: code = NotFound desc = could not find container \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": container with ID starting with 6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25 not found: ID does not exist"
Sep 11 12:53:27.622493 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.622285    2572 scope.go:117] "RemoveContainer" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.622767 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:53:27.622750    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": container with ID starting with 8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03 not found: ID does not exist" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.622825 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.622773    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"} err="failed to get container status \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": rpc error: code = NotFound desc = could not find container \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": container with ID starting with 8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03 not found: ID does not exist"
Sep 11 12:53:27.622825 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.622792    2572 scope.go:117] "RemoveContainer" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.623084 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:53:27.623068    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": container with ID starting with b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f not found: ID does not exist" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.623127 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623088    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"} err="failed to get container status \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": rpc error: code = NotFound desc = could not find container \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": container with ID starting with b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f not found: ID does not exist"
Sep 11 12:53:27.623127 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623103    2572 scope.go:117] "RemoveContainer" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.623436 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:53:27.623414    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": container with ID starting with b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4 not found: ID does not exist" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.623511 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623446    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"} err="failed to get container status \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": rpc error: code = NotFound desc = could not find container \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": container with ID starting with b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4 not found: ID does not exist"
Sep 11 12:53:27.623511 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623462    2572 scope.go:117] "RemoveContainer" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.623708 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623690    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"} err="failed to get container status \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": rpc error: code = NotFound desc = could not find container \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": container with ID starting with 099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02 not found: ID does not exist"
Sep 11 12:53:27.623774 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623707    2572 scope.go:117] "RemoveContainer" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.623960 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623943    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"} err="failed to get container status \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": rpc error: code = NotFound desc = could not find container \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": container with ID starting with 0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b not found: ID does not exist"
Sep 11 12:53:27.623994 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.623961    2572 scope.go:117] "RemoveContainer" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.624237 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624219    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"} err="failed to get container status \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": rpc error: code = NotFound desc = could not find container \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": container with ID starting with 6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5 not found: ID does not exist"
Sep 11 12:53:27.624281 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624239    2572 scope.go:117] "RemoveContainer" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.624509 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624486    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"} err="failed to get container status \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": rpc error: code = NotFound desc = could not find container \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": container with ID starting with 6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25 not found: ID does not exist"
Sep 11 12:53:27.624582 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624510    2572 scope.go:117] "RemoveContainer" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.624766 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624747    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"} err="failed to get container status \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": rpc error: code = NotFound desc = could not find container \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": container with ID starting with 8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03 not found: ID does not exist"
Sep 11 12:53:27.624827 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624767    2572 scope.go:117] "RemoveContainer" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.624996 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624982    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"} err="failed to get container status \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": rpc error: code = NotFound desc = could not find container \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": container with ID starting with b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f not found: ID does not exist"
Sep 11 12:53:27.624996 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.624996    2572 scope.go:117] "RemoveContainer" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.625216 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.625199    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"} err="failed to get container status \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": rpc error: code = NotFound desc = could not find container \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": container with ID starting with b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4 not found: ID does not exist"
Sep 11 12:53:27.625274 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.625217    2572 scope.go:117] "RemoveContainer" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.625382 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.625369    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.625475 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.625459    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"} err="failed to get container status \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": rpc error: code = NotFound desc = could not find container \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": container with ID starting with 099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02 not found: ID does not exist"
Sep 11 12:53:27.625520 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.625475    2572 scope.go:117] "RemoveContainer" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.625821 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.625728    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"} err="failed to get container status \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": rpc error: code = NotFound desc = could not find container \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": container with ID starting with 0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b not found: ID does not exist"
Sep 11 12:53:27.625821 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.625758    2572 scope.go:117] "RemoveContainer" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.626125 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626040    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"} err="failed to get container status \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": rpc error: code = NotFound desc = could not find container \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": container with ID starting with 6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5 not found: ID does not exist"
Sep 11 12:53:27.626125 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626059    2572 scope.go:117] "RemoveContainer" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.626350 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626307    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"} err="failed to get container status \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": rpc error: code = NotFound desc = could not find container \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": container with ID starting with 6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25 not found: ID does not exist"
Sep 11 12:53:27.626350 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626350    2572 scope.go:117] "RemoveContainer" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.626617 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626595    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"} err="failed to get container status \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": rpc error: code = NotFound desc = could not find container \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": container with ID starting with 8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03 not found: ID does not exist"
Sep 11 12:53:27.626663 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626621    2572 scope.go:117] "RemoveContainer" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.626892 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626876    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"} err="failed to get container status \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": rpc error: code = NotFound desc = could not find container \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": container with ID starting with b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f not found: ID does not exist"
Sep 11 12:53:27.626935 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.626893    2572 scope.go:117] "RemoveContainer" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.627184 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.627161    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"} err="failed to get container status \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": rpc error: code = NotFound desc = could not find container \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": container with ID starting with b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4 not found: ID does not exist"
Sep 11 12:53:27.627184 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.627179    2572 scope.go:117] "RemoveContainer" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.627495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.627476    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"} err="failed to get container status \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": rpc error: code = NotFound desc = could not find container \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": container with ID starting with 099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02 not found: ID does not exist"
Sep 11 12:53:27.627551 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.627495    2572 scope.go:117] "RemoveContainer" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.627763 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.627745    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"} err="failed to get container status \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": rpc error: code = NotFound desc = could not find container \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": container with ID starting with 0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b not found: ID does not exist"
Sep 11 12:53:27.627763 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.627763    2572 scope.go:117] "RemoveContainer" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.628029 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628006    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"} err="failed to get container status \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": rpc error: code = NotFound desc = could not find container \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": container with ID starting with 6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5 not found: ID does not exist"
Sep 11 12:53:27.628029 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628025    2572 scope.go:117] "RemoveContainer" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.628297 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628278    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"} err="failed to get container status \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": rpc error: code = NotFound desc = could not find container \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": container with ID starting with 6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25 not found: ID does not exist"
Sep 11 12:53:27.628395 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628298    2572 scope.go:117] "RemoveContainer" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.628395 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628389    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 12:53:27.628652 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628606    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 12:53:27.628652 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628619    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m55jm\""
Sep 11 12:53:27.628786 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628666    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 12:53:27.628786 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628678    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 12:53:27.628786 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628766    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 12:53:27.628922 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628788    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 12:53:27.628922 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628793    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 12:53:27.628922 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628854    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 12:53:27.628922 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628794    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"} err="failed to get container status \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": rpc error: code = NotFound desc = could not find container \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": container with ID starting with 8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03 not found: ID does not exist"
Sep 11 12:53:27.628922 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628886    2572 scope.go:117] "RemoveContainer" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.629156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628933    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 12:53:27.629156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628989    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 12:53:27.629156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.628993    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5bj8rhlu7nv4\""
Sep 11 12:53:27.629156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629055    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 12:53:27.629156 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629122    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 12:53:27.629390 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629172    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"} err="failed to get container status \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": rpc error: code = NotFound desc = could not find container \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": container with ID starting with b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f not found: ID does not exist"
Sep 11 12:53:27.629390 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629196    2572 scope.go:117] "RemoveContainer" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.629620 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629595    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"} err="failed to get container status \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": rpc error: code = NotFound desc = could not find container \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": container with ID starting with b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4 not found: ID does not exist"
Sep 11 12:53:27.629698 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629623    2572 scope.go:117] "RemoveContainer" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.629939 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629906    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"} err="failed to get container status \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": rpc error: code = NotFound desc = could not find container \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": container with ID starting with 099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02 not found: ID does not exist"
Sep 11 12:53:27.629939 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.629934    2572 scope.go:117] "RemoveContainer" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.630465 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.630438    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"} err="failed to get container status \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": rpc error: code = NotFound desc = could not find container \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": container with ID starting with 0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b not found: ID does not exist"
Sep 11 12:53:27.630562 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.630467    2572 scope.go:117] "RemoveContainer" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.630850 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.630827    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"} err="failed to get container status \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": rpc error: code = NotFound desc = could not find container \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": container with ID starting with 6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5 not found: ID does not exist"
Sep 11 12:53:27.630850 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.630846    2572 scope.go:117] "RemoveContainer" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.631090 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.631071    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"} err="failed to get container status \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": rpc error: code = NotFound desc = could not find container \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": container with ID starting with 6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25 not found: ID does not exist"
Sep 11 12:53:27.631222 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.631090    2572 scope.go:117] "RemoveContainer" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.631455 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.631434    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"} err="failed to get container status \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": rpc error: code = NotFound desc = could not find container \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": container with ID starting with 8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03 not found: ID does not exist"
Sep 11 12:53:27.631558 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.631456    2572 scope.go:117] "RemoveContainer" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.631612 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.631579    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 12:53:27.631789 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.631767    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"} err="failed to get container status \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": rpc error: code = NotFound desc = could not find container \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": container with ID starting with b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f not found: ID does not exist"
Sep 11 12:53:27.631839 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.631792    2572 scope.go:117] "RemoveContainer" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.632025 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632004    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"} err="failed to get container status \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": rpc error: code = NotFound desc = could not find container \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": container with ID starting with b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4 not found: ID does not exist"
Sep 11 12:53:27.632082 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632026    2572 scope.go:117] "RemoveContainer" containerID="099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"
Sep 11 12:53:27.632241 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632223    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02"} err="failed to get container status \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": rpc error: code = NotFound desc = could not find container \"099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02\": container with ID starting with 099c02fdc4d245cb4310bb0b45aca54f0c8e494c0fec82858174e821e4396c02 not found: ID does not exist"
Sep 11 12:53:27.632282 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632241    2572 scope.go:117] "RemoveContainer" containerID="0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"
Sep 11 12:53:27.632510 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632487    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b"} err="failed to get container status \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": rpc error: code = NotFound desc = could not find container \"0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b\": container with ID starting with 0f1a7c3d9af2793a3d98a8e953b78a08207f5f931f8ab6e9ab1ccb1dcd87c30b not found: ID does not exist"
Sep 11 12:53:27.632510 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632510    2572 scope.go:117] "RemoveContainer" containerID="6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"
Sep 11 12:53:27.632865 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632821    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5"} err="failed to get container status \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": rpc error: code = NotFound desc = could not find container \"6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5\": container with ID starting with 6163b766e7690f853fcd94a3b470da56ad0a035007fb446678b44b22ad6ec7e5 not found: ID does not exist"
Sep 11 12:53:27.632922 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.632868    2572 scope.go:117] "RemoveContainer" containerID="6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"
Sep 11 12:53:27.633157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.633136    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25"} err="failed to get container status \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": rpc error: code = NotFound desc = could not find container \"6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25\": container with ID starting with 6ecbe51ff3e515e469ff6749a8c3d08c9181aca45b0fb3597ff2a7043d320b25 not found: ID does not exist"
Sep 11 12:53:27.633157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.633157    2572 scope.go:117] "RemoveContainer" containerID="8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"
Sep 11 12:53:27.633450 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.633427    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03"} err="failed to get container status \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": rpc error: code = NotFound desc = could not find container \"8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03\": container with ID starting with 8564a817789922f388b0c62b87d8e06856ee70546ca074a1d85141b5f9ca5e03 not found: ID does not exist"
Sep 11 12:53:27.633534 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.633453    2572 scope.go:117] "RemoveContainer" containerID="b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"
Sep 11 12:53:27.633864 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.633717    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f"} err="failed to get container status \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": rpc error: code = NotFound desc = could not find container \"b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f\": container with ID starting with b681fdd52c867753be74e4ff8c72e38ad7f5c0267cec4f75ab8c0e99a868621f not found: ID does not exist"
Sep 11 12:53:27.633864 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.633738    2572 scope.go:117] "RemoveContainer" containerID="b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"
Sep 11 12:53:27.634070 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.634041    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4"} err="failed to get container status \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": rpc error: code = NotFound desc = could not find container \"b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4\": container with ID starting with b6563f608577b98af87eca996a9f916f09b62763cd7894b048510141b253abe4 not found: ID does not exist"
Sep 11 12:53:27.634342 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.634301    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 12:53:27.644014 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.643989    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:53:27.778892 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.778835    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.778892 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.778886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.778892 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.778907    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.778981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpndm\" (UniqueName: \"kubernetes.io/projected/158da54a-87cf-4c98-9d6c-b4a788d5a242-kube-api-access-zpndm\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779011    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779056    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779157 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779174    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779237    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/158da54a-87cf-4c98-9d6c-b4a788d5a242-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-web-config\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779375    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/158da54a-87cf-4c98-9d6c-b4a788d5a242-config-out\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779396    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-config\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779495 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779474    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.779810 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.779505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880308 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/158da54a-87cf-4c98-9d6c-b4a788d5a242-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880308 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-web-config\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880308 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/158da54a-87cf-4c98-9d6c-b4a788d5a242-config-out\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880308 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880291    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-config\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880536    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.880632 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880621    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880657    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpndm\" (UniqueName: \"kubernetes.io/projected/158da54a-87cf-4c98-9d6c-b4a788d5a242-kube-api-access-zpndm\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880758    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880782    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880833    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880890    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881010 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.880913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881643 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.881220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.881702 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.881678    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.883286 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.882076    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.883286 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.882538    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.883286 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.882749    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.883286 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.883054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.883801 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.883779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-config\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.883878 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.883860    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.884240 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.884126    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/158da54a-87cf-4c98-9d6c-b4a788d5a242-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.884457 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.884436    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-web-config\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.885078 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.885053    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/158da54a-87cf-4c98-9d6c-b4a788d5a242-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.885244 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.885223    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.885371 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.885272    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.885921 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.885897    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/158da54a-87cf-4c98-9d6c-b4a788d5a242-config-out\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.886026 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.886005    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.886257 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.886239    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.886568 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.886550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.886654 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.886641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.887016 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.887002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/158da54a-87cf-4c98-9d6c-b4a788d5a242-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.889548 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.889531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpndm\" (UniqueName: \"kubernetes.io/projected/158da54a-87cf-4c98-9d6c-b4a788d5a242-kube-api-access-zpndm\") pod \"prometheus-k8s-0\" (UID: \"158da54a-87cf-4c98-9d6c-b4a788d5a242\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:27.937188 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:27.937149    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:53:28.139513 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:28.139413    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3186a82-16e5-488f-85d7-00a217fefd07" path="/var/lib/kubelet/pods/f3186a82-16e5-488f-85d7-00a217fefd07/volumes"
Sep 11 12:53:28.216089 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:28.216046    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:53:28.220107 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:53:28.220074    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158da54a_87cf_4c98_9d6c_b4a788d5a242.slice/crio-0bdb09da6ded3e1d1eb7079759e0cbf9e77a38854add5c0533b795d22e483623 WatchSource:0}: Error finding container 0bdb09da6ded3e1d1eb7079759e0cbf9e77a38854add5c0533b795d22e483623: Status 404 returned error can't find the container with id 0bdb09da6ded3e1d1eb7079759e0cbf9e77a38854add5c0533b795d22e483623
Sep 11 12:53:28.572501 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:28.572471    2572 generic.go:356] "Generic (PLEG): container finished" podID="158da54a-87cf-4c98-9d6c-b4a788d5a242" containerID="849020b2f037214dad476116f9198e7444fdc536c26022cc502ba70862d19d15" exitCode=0
Sep 11 12:53:28.572666 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:28.572531    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerDied","Data":"849020b2f037214dad476116f9198e7444fdc536c26022cc502ba70862d19d15"}
Sep 11 12:53:28.572666 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:28.572580    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerStarted","Data":"0bdb09da6ded3e1d1eb7079759e0cbf9e77a38854add5c0533b795d22e483623"}
Sep 11 12:53:28.990047 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:28.990011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:53:28.992524 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:28.992502    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678675e-a199-4e06-9951-1a3f01f03feb-metrics-certs\") pod \"network-metrics-daemon-c2d6c\" (UID: \"3678675e-a199-4e06-9951-1a3f01f03feb\") " pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:53:29.236651 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.236620    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86zcf\""
Sep 11 12:53:29.245398 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.245377    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c2d6c"
Sep 11 12:53:29.513216 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.513136    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c2d6c"]
Sep 11 12:53:29.516827 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:53:29.516788    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3678675e_a199_4e06_9951_1a3f01f03feb.slice/crio-77922d64c9d8cc593d85a905c8f82bd223c4a36a1b2603b06839dd89c7a76ba3 WatchSource:0}: Error finding container 77922d64c9d8cc593d85a905c8f82bd223c4a36a1b2603b06839dd89c7a76ba3: Status 404 returned error can't find the container with id 77922d64c9d8cc593d85a905c8f82bd223c4a36a1b2603b06839dd89c7a76ba3
Sep 11 12:53:29.518945 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.518930    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:53:29.579639 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.579601    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerStarted","Data":"0c41cf390dfd2e9a15a5b71f0b5e00c156cbd7cfbf6bd951352b4551805f6eae"}
Sep 11 12:53:29.579811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.579671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerStarted","Data":"851951ad91b9b5f3733cc1c7fc331e009524ffe6a5f805da741b90a6d3d6d510"}
Sep 11 12:53:29.579811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.579698    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerStarted","Data":"78a1ad0d286024c393287eca52fa8eeb05f7bb7e4d6ebe195c3e4e52e7fcec1e"}
Sep 11 12:53:29.579811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.579741    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerStarted","Data":"a8678f075ce99ab6c92047f28b6d668b0edd2d1cc5ff88dd38ddf7768dd498b2"}
Sep 11 12:53:29.579811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.579779    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerStarted","Data":"86c93242105a2882295befa424e749263c7ec7a3b76d1421b9a7576c27a11ee0"}
Sep 11 12:53:29.579811 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.579813    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"158da54a-87cf-4c98-9d6c-b4a788d5a242","Type":"ContainerStarted","Data":"73d25acf6fe770a14d653efbc7e4328f751eaa391b3f5f8adf5630ef6d42daa3"}
Sep 11 12:53:29.580855 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.580834    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c2d6c" event={"ID":"3678675e-a199-4e06-9951-1a3f01f03feb","Type":"ContainerStarted","Data":"77922d64c9d8cc593d85a905c8f82bd223c4a36a1b2603b06839dd89c7a76ba3"}
Sep 11 12:53:29.606494 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:29.606432    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.58810042 podStartE2EDuration="2.606402274s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.301854ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:29.604911234 +0000 UTC m=+373.984437208" watchObservedRunningTime="2026-09-11 12:53:29.606402274 +0000 UTC m=+373.985928211"
Sep 11 12:53:30.586888 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:30.586702    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c2d6c" event={"ID":"3678675e-a199-4e06-9951-1a3f01f03feb","Type":"ContainerStarted","Data":"76503967d8a0876ad47445360973c28bbf08dc9c5141f30018855bf5d1668dd0"}
Sep 11 12:53:30.586888 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:30.586768    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c2d6c" event={"ID":"3678675e-a199-4e06-9951-1a3f01f03feb","Type":"ContainerStarted","Data":"370b4db410d656c77a11877ec3a2c6333e4844bc4b6aa5ceeecbd2fcd63b530f"}
Sep 11 12:53:30.602261 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:30.602192    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c2d6c" podStartSLOduration=373.820420581 podStartE2EDuration="6m14.602172055s" totalImagesPullingTime="781.751474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:30.601453957 +0000 UTC m=+374.980979894" watchObservedRunningTime="2026-09-11 12:53:30.602172055 +0000 UTC m=+374.981697991"
Sep 11 12:53:32.937560 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:53:32.937522    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:54:27.937762 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:54:27.937727    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:54:27.953615 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:54:27.953591    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:54:28.810270 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:54:28.810241    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:55:42.003830 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.003801    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"]
Sep 11 12:55:42.006989 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.006962    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.009899 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.009877    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 12:55:42.010219 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.010198    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 12:55:42.010313 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.010246    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 12:55:42.010608 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.010586    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 12:55:42.010608 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.010600    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5m6lg\""
Sep 11 12:55:42.023426 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.023397    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"]
Sep 11 12:55:42.117512 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.117474    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29mqb\" (UniqueName: \"kubernetes.io/projected/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-kube-api-access-29mqb\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.117675 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.117515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.117675 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.117622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-tmp\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.117675 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.117656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.117775 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.117684    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-manifests\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.218298 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.218260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29mqb\" (UniqueName: \"kubernetes.io/projected/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-kube-api-access-29mqb\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.218298 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.218297    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.218570 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.218382    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-tmp\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.218570 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.218398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.218570 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.218439    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-manifests\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.218856 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.218825    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-manifests\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.220951 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.220929    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.220951 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.220938    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-tmp\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.221109 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.221094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.228721 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.228698    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29mqb\" (UniqueName: \"kubernetes.io/projected/c58533ed-29e8-4fd8-8fcf-b8c841556f1d-kube-api-access-29mqb\") pod \"opendatahub-operator-controller-manager-7cbb4999dc-zh98f\" (UID: \"c58533ed-29e8-4fd8-8fcf-b8c841556f1d\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.316740 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.316659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:42.598872 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:42.598790    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"]
Sep 11 12:55:42.604654 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:55:42.604627    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58533ed_29e8_4fd8_8fcf_b8c841556f1d.slice/crio-bcd9bdfc28a4f40650fc24f32e8dcad272f3c52ded71d830c6b44579bce1dc6a WatchSource:0}: Error finding container bcd9bdfc28a4f40650fc24f32e8dcad272f3c52ded71d830c6b44579bce1dc6a: Status 404 returned error can't find the container with id bcd9bdfc28a4f40650fc24f32e8dcad272f3c52ded71d830c6b44579bce1dc6a
Sep 11 12:55:43.048297 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:43.048263    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f" event={"ID":"c58533ed-29e8-4fd8-8fcf-b8c841556f1d","Type":"ContainerStarted","Data":"bcd9bdfc28a4f40650fc24f32e8dcad272f3c52ded71d830c6b44579bce1dc6a"}
Sep 11 12:55:46.061973 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:46.061884    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f" event={"ID":"c58533ed-29e8-4fd8-8fcf-b8c841556f1d","Type":"ContainerStarted","Data":"a3d31e82eb9e8aeecc0dc2d0e7016a59e1b2181f8ef6229cfe17839683c74457"}
Sep 11 12:55:47.067230 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:47.067192    2572 generic.go:356] "Generic (PLEG): container finished" podID="c58533ed-29e8-4fd8-8fcf-b8c841556f1d" containerID="a3d31e82eb9e8aeecc0dc2d0e7016a59e1b2181f8ef6229cfe17839683c74457" exitCode=0
Sep 11 12:55:47.067642 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:47.067296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f" event={"ID":"c58533ed-29e8-4fd8-8fcf-b8c841556f1d","Type":"ContainerDied","Data":"a3d31e82eb9e8aeecc0dc2d0e7016a59e1b2181f8ef6229cfe17839683c74457"}
Sep 11 12:55:48.072931 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:48.072896    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f" event={"ID":"c58533ed-29e8-4fd8-8fcf-b8c841556f1d","Type":"ContainerStarted","Data":"8573e162871d17931a738e1386adb1fb627de208c0c3afdf4afaa5fb17b2850e"}
Sep 11 12:55:48.073336 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:48.072999    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:48.092728 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:48.092675    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f" podStartSLOduration=2.521364632 podStartE2EDuration="7.092661186s" totalImagesPullingTime="3.481932804s" totalInitContainerRuntime="1.08936375s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:48.092017736 +0000 UTC m=+512.471543674" watchObservedRunningTime="2026-09-11 12:55:48.092661186 +0000 UTC m=+512.472187121"
Sep 11 12:55:59.079230 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.079201    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbb4999dc-zh98f"
Sep 11 12:55:59.490684 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.490655    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"]
Sep 11 12:55:59.499485 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.499464    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.501835 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.501809    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 12:55:59.501959 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.501946    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 12:55:59.502015 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.501955    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:55:59.502064 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.502025    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 12:55:59.502118 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.502106    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"]
Sep 11 12:55:59.502608 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.502592    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zgw8r\""
Sep 11 12:55:59.502683 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.502632    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 12:55:59.548172 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.548147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47714c3d-6a85-42bf-be66-632c87b7473f-cert\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.548344 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.548192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47714c3d-6a85-42bf-be66-632c87b7473f-metrics-cert\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.548344 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.548217    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47714c3d-6a85-42bf-be66-632c87b7473f-manager-config\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.548344 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.548288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpxt9\" (UniqueName: \"kubernetes.io/projected/47714c3d-6a85-42bf-be66-632c87b7473f-kube-api-access-bpxt9\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.648661 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.648628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47714c3d-6a85-42bf-be66-632c87b7473f-manager-config\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.648807 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.648672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpxt9\" (UniqueName: \"kubernetes.io/projected/47714c3d-6a85-42bf-be66-632c87b7473f-kube-api-access-bpxt9\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.648807 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.648792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47714c3d-6a85-42bf-be66-632c87b7473f-cert\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.648892 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.648843    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47714c3d-6a85-42bf-be66-632c87b7473f-metrics-cert\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.649298 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.649281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47714c3d-6a85-42bf-be66-632c87b7473f-manager-config\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.651457 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.651434    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47714c3d-6a85-42bf-be66-632c87b7473f-metrics-cert\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.651536 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.651519    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47714c3d-6a85-42bf-be66-632c87b7473f-cert\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.656083 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.656065    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpxt9\" (UniqueName: \"kubernetes.io/projected/47714c3d-6a85-42bf-be66-632c87b7473f-kube-api-access-bpxt9\") pod \"lws-controller-manager-5655dcc49-d7gpb\" (UID: \"47714c3d-6a85-42bf-be66-632c87b7473f\") " pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:55:59.810454 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:55:59.810372    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:56:00.079616 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:00.079542    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"]
Sep 11 12:56:00.082518 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:56:00.082490    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47714c3d_6a85_42bf_be66_632c87b7473f.slice/crio-528a9e46235be875b16e262586dfe83706c7618393c717280aeed69b9a4e1d85 WatchSource:0}: Error finding container 528a9e46235be875b16e262586dfe83706c7618393c717280aeed69b9a4e1d85: Status 404 returned error can't find the container with id 528a9e46235be875b16e262586dfe83706c7618393c717280aeed69b9a4e1d85
Sep 11 12:56:00.116948 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:00.116916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb" event={"ID":"47714c3d-6a85-42bf-be66-632c87b7473f","Type":"ContainerStarted","Data":"528a9e46235be875b16e262586dfe83706c7618393c717280aeed69b9a4e1d85"}
Sep 11 12:56:03.131714 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:03.131679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb" event={"ID":"47714c3d-6a85-42bf-be66-632c87b7473f","Type":"ContainerStarted","Data":"a05edc60859ef99abf6c6f0fcd5ec308c368f378b05df2ccb85e3b82354ad142"}
Sep 11 12:56:03.132125 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:03.131747    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:56:03.190090 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:03.190030    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb" podStartSLOduration=1.7915083809999999 podStartE2EDuration="4.190013868s" totalImagesPullingTime="2.398505487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:03.187669891 +0000 UTC m=+527.567195827" watchObservedRunningTime="2026-09-11 12:56:03.190013868 +0000 UTC m=+527.569539805"
Sep 11 12:56:09.482395 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.482304    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"]
Sep 11 12:56:09.485572 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.485549    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.488069 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.488048    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 12:56:09.488170 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.488086    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 12:56:09.488494 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.488475    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zlwq5\""
Sep 11 12:56:09.488603 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.488564    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 12:56:09.496908 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.496884    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"]
Sep 11 12:56:09.534334 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534341    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cp4f\" (UniqueName: \"kubernetes.io/projected/164f6b6e-c466-484f-954c-4fb747df7c6e-kube-api-access-9cp4f\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534505 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534489    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534720 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534532    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164f6b6e-c466-484f-954c-4fb747df7c6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.534720 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.534566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635374 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635525 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635388    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635525 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635624 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635624 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635624 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cp4f\" (UniqueName: \"kubernetes.io/projected/164f6b6e-c466-484f-954c-4fb747df7c6e-kube-api-access-9cp4f\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635678    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635764 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635707    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164f6b6e-c466-484f-954c-4fb747df7c6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635923 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.635923 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.635888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.636053 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.636033    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.636209 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.636187    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.636661 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.636633    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/164f6b6e-c466-484f-954c-4fb747df7c6e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.637963 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.637934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.638232 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.638211    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.644193 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.644172    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/164f6b6e-c466-484f-954c-4fb747df7c6e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.644441 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.644417    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cp4f\" (UniqueName: \"kubernetes.io/projected/164f6b6e-c466-484f-954c-4fb747df7c6e-kube-api-access-9cp4f\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cs86zs\" (UID: \"164f6b6e-c466-484f-954c-4fb747df7c6e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:09.795704 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:09.795619    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:10.075875 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:10.075794    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"]
Sep 11 12:56:10.078938 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:56:10.078913    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164f6b6e_c466_484f_954c_4fb747df7c6e.slice/crio-b75f4522d67777d1bc80cb9e779639738d788835497a2b32e0cde55f9e54a575 WatchSource:0}: Error finding container b75f4522d67777d1bc80cb9e779639738d788835497a2b32e0cde55f9e54a575: Status 404 returned error can't find the container with id b75f4522d67777d1bc80cb9e779639738d788835497a2b32e0cde55f9e54a575
Sep 11 12:56:10.156921 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:10.156887    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs" event={"ID":"164f6b6e-c466-484f-954c-4fb747df7c6e","Type":"ContainerStarted","Data":"b75f4522d67777d1bc80cb9e779639738d788835497a2b32e0cde55f9e54a575"}
Sep 11 12:56:12.859528 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:12.859478    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 12:56:12.859810 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:12.859576    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 12:56:12.859810 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:12.859607    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 12:56:12.989022 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:12.988988    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wssvg"]
Sep 11 12:56:12.993063 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:12.993040    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:12.994971 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:12.994943    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 12:56:13.005592 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.005565    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wssvg"]
Sep 11 12:56:13.069101 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.069061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-tls-certs\") pod \"model-serving-api-54d89bd5fc-wssvg\" (UID: \"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4\") " pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:13.069294 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.069116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4682f\" (UniqueName: \"kubernetes.io/projected/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-kube-api-access-4682f\") pod \"model-serving-api-54d89bd5fc-wssvg\" (UID: \"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4\") " pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:13.169679 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.169645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-tls-certs\") pod \"model-serving-api-54d89bd5fc-wssvg\" (UID: \"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4\") " pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:13.170152 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:56:13.170126    2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 11 12:56:13.170152 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.170138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4682f\" (UniqueName: \"kubernetes.io/projected/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-kube-api-access-4682f\") pod \"model-serving-api-54d89bd5fc-wssvg\" (UID: \"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4\") " pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:13.170388 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:56:13.170220    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-tls-certs podName:edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:13.670185367 +0000 UTC m=+538.049711295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-tls-certs") pod "model-serving-api-54d89bd5fc-wssvg" (UID: "edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4") : secret "model-serving-api-tls" not found
Sep 11 12:56:13.176008 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.175971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs" event={"ID":"164f6b6e-c466-484f-954c-4fb747df7c6e","Type":"ContainerStarted","Data":"1549e8981211539f73268d08f85761b01f707bcef41bd85e901775808ca29ae6"}
Sep 11 12:56:13.178826 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.178806    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4682f\" (UniqueName: \"kubernetes.io/projected/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-kube-api-access-4682f\") pod \"model-serving-api-54d89bd5fc-wssvg\" (UID: \"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4\") " pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:13.198188 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.198140    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs" podStartSLOduration=1.420282372 podStartE2EDuration="4.198124044s" totalImagesPullingTime="2.777841672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:13.197207411 +0000 UTC m=+537.576733348" watchObservedRunningTime="2026-09-11 12:56:13.198124044 +0000 UTC m=+537.577649980"
Sep 11 12:56:13.675191 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.675151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-tls-certs\") pod \"model-serving-api-54d89bd5fc-wssvg\" (UID: \"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4\") " pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:13.677634 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.677610    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4-tls-certs\") pod \"model-serving-api-54d89bd5fc-wssvg\" (UID: \"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4\") " pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:13.796429 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.796382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:13.802492 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.802466    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:13.906598 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:13.906570    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:14.138268 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:14.138245    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5655dcc49-d7gpb"
Sep 11 12:56:14.180559 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:14.180527    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wssvg"]
Sep 11 12:56:14.181773 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:14.181751    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:14.182982 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:14.182892    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cs86zs"
Sep 11 12:56:14.185771 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:56:14.185747    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedab90c5_2bb5_4f2e_a45b_ef22ae1f3cc4.slice/crio-cb4cd83821eac40efabfe4e7a097542002bb4074dff9db7c4c05d0339e946849 WatchSource:0}: Error finding container cb4cd83821eac40efabfe4e7a097542002bb4074dff9db7c4c05d0339e946849: Status 404 returned error can't find the container with id cb4cd83821eac40efabfe4e7a097542002bb4074dff9db7c4c05d0339e946849
Sep 11 12:56:15.188612 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:15.188575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wssvg" event={"ID":"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4","Type":"ContainerStarted","Data":"cb4cd83821eac40efabfe4e7a097542002bb4074dff9db7c4c05d0339e946849"}
Sep 11 12:56:17.199545 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:17.199501    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wssvg" event={"ID":"edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4","Type":"ContainerStarted","Data":"21761fdb6b4407847ac08062323f757881157cd9d62c6cedf97788654793561e"}
Sep 11 12:56:17.199997 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:17.199644    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:17.217212 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:17.217156    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wssvg" podStartSLOduration=2.834509924 podStartE2EDuration="5.217139221s" totalImagesPullingTime="2.382629297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:17.215311865 +0000 UTC m=+541.594837815" watchObservedRunningTime="2026-09-11 12:56:17.217139221 +0000 UTC m=+541.596665156"
Sep 11 12:56:22.581207 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.581176    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"]
Sep 11 12:56:22.584528 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.584501    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:22.586916 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.586890    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 12:56:22.587018 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.586919    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-49qrf\""
Sep 11 12:56:22.601923 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.601893    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"]
Sep 11 12:56:22.656307 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.656279    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b69e3466-801b-439e-9141-2ba086a73d51-cert\") pod \"kserve-controller-manager-d6f4b65b8-grzwd\" (UID: \"b69e3466-801b-439e-9141-2ba086a73d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:22.656465 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.656334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gpxv\" (UniqueName: \"kubernetes.io/projected/b69e3466-801b-439e-9141-2ba086a73d51-kube-api-access-6gpxv\") pod \"kserve-controller-manager-d6f4b65b8-grzwd\" (UID: \"b69e3466-801b-439e-9141-2ba086a73d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:22.757660 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.757633    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b69e3466-801b-439e-9141-2ba086a73d51-cert\") pod \"kserve-controller-manager-d6f4b65b8-grzwd\" (UID: \"b69e3466-801b-439e-9141-2ba086a73d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:22.757835 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.757677    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gpxv\" (UniqueName: \"kubernetes.io/projected/b69e3466-801b-439e-9141-2ba086a73d51-kube-api-access-6gpxv\") pod \"kserve-controller-manager-d6f4b65b8-grzwd\" (UID: \"b69e3466-801b-439e-9141-2ba086a73d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:22.757835 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:56:22.757796    2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 12:56:22.757953 ip-10-0-136-247 kubenswrapper[2572]: E0911 12:56:22.757860    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e3466-801b-439e-9141-2ba086a73d51-cert podName:b69e3466-801b-439e-9141-2ba086a73d51 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:23.257842945 +0000 UTC m=+547.637368864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b69e3466-801b-439e-9141-2ba086a73d51-cert") pod "kserve-controller-manager-d6f4b65b8-grzwd" (UID: "b69e3466-801b-439e-9141-2ba086a73d51") : secret "kserve-webhook-server-cert" not found
Sep 11 12:56:22.780816 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:22.780789    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gpxv\" (UniqueName: \"kubernetes.io/projected/b69e3466-801b-439e-9141-2ba086a73d51-kube-api-access-6gpxv\") pod \"kserve-controller-manager-d6f4b65b8-grzwd\" (UID: \"b69e3466-801b-439e-9141-2ba086a73d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:23.260743 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:23.260713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b69e3466-801b-439e-9141-2ba086a73d51-cert\") pod \"kserve-controller-manager-d6f4b65b8-grzwd\" (UID: \"b69e3466-801b-439e-9141-2ba086a73d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:23.263220 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:23.263194    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b69e3466-801b-439e-9141-2ba086a73d51-cert\") pod \"kserve-controller-manager-d6f4b65b8-grzwd\" (UID: \"b69e3466-801b-439e-9141-2ba086a73d51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:23.494808 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:23.494775    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:23.770857 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:23.770826    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"]
Sep 11 12:56:23.773206 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:56:23.773167    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69e3466_801b_439e_9141_2ba086a73d51.slice/crio-8c07b63ba0a8e1d1288ad5198033da6bc9bea64b722d377ca370062169bdb6c7 WatchSource:0}: Error finding container 8c07b63ba0a8e1d1288ad5198033da6bc9bea64b722d377ca370062169bdb6c7: Status 404 returned error can't find the container with id 8c07b63ba0a8e1d1288ad5198033da6bc9bea64b722d377ca370062169bdb6c7
Sep 11 12:56:24.227886 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:24.227856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd" event={"ID":"b69e3466-801b-439e-9141-2ba086a73d51","Type":"ContainerStarted","Data":"8c07b63ba0a8e1d1288ad5198033da6bc9bea64b722d377ca370062169bdb6c7"}
Sep 11 12:56:26.239587 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:26.239555    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd" event={"ID":"b69e3466-801b-439e-9141-2ba086a73d51","Type":"ContainerStarted","Data":"b452bb4271600a4c961f1397151aa5749f73ac07f3cc209dd3e649fc48af52b6"}
Sep 11 12:56:26.240020 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:26.239722    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:56:26.265617 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:26.265575    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd" podStartSLOduration=2.285626086 podStartE2EDuration="4.265558199s" totalImagesPullingTime="1.979932113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:26.264131957 +0000 UTC m=+550.643657893" watchObservedRunningTime="2026-09-11 12:56:26.265558199 +0000 UTC m=+550.645084136"
Sep 11 12:56:28.207375 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:28.207347    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wssvg"
Sep 11 12:56:57.248200 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:56:57.248169    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-grzwd"
Sep 11 12:57:16.059934 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:16.059906    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:57:16.060491 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:16.060289    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 12:57:39.083981 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.083904    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-9t8p8"]
Sep 11 12:57:39.087120 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.087102    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8"
Sep 11 12:57:39.089441 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.089421    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 12:57:39.089559 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.089464    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vxzg4\""
Sep 11 12:57:39.089705 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.089693    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 12:57:39.099174 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.099151    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-9t8p8"]
Sep 11 12:57:39.196837 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.196803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br2g6\" (UniqueName: \"kubernetes.io/projected/51b842ec-53d9-405c-8f6c-f927317249ed-kube-api-access-br2g6\") pod \"authorino-operator-76b478bd78-9t8p8\" (UID: \"51b842ec-53d9-405c-8f6c-f927317249ed\") " pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8"
Sep 11 12:57:39.297392 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.297351    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2g6\" (UniqueName: \"kubernetes.io/projected/51b842ec-53d9-405c-8f6c-f927317249ed-kube-api-access-br2g6\") pod \"authorino-operator-76b478bd78-9t8p8\" (UID: \"51b842ec-53d9-405c-8f6c-f927317249ed\") " pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8"
Sep 11 12:57:39.310202 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.310163    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br2g6\" (UniqueName: \"kubernetes.io/projected/51b842ec-53d9-405c-8f6c-f927317249ed-kube-api-access-br2g6\") pod \"authorino-operator-76b478bd78-9t8p8\" (UID: \"51b842ec-53d9-405c-8f6c-f927317249ed\") " pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8"
Sep 11 12:57:39.397153 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.397119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8"
Sep 11 12:57:39.673702 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:39.673570    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-9t8p8"]
Sep 11 12:57:39.676290 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:57:39.676257    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b842ec_53d9_405c_8f6c_f927317249ed.slice/crio-0e1a36b8545a4098f20c2c3c948879c84102c78f006215791a027afca86f8f4c WatchSource:0}: Error finding container 0e1a36b8545a4098f20c2c3c948879c84102c78f006215791a027afca86f8f4c: Status 404 returned error can't find the container with id 0e1a36b8545a4098f20c2c3c948879c84102c78f006215791a027afca86f8f4c
Sep 11 12:57:40.532542 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:40.532511    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8" event={"ID":"51b842ec-53d9-405c-8f6c-f927317249ed","Type":"ContainerStarted","Data":"0e1a36b8545a4098f20c2c3c948879c84102c78f006215791a027afca86f8f4c"}
Sep 11 12:57:43.548093 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:43.548056    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8" event={"ID":"51b842ec-53d9-405c-8f6c-f927317249ed","Type":"ContainerStarted","Data":"90f12e5592e12c8f2bcb557efb70cd7ebc093f55c54f76cc3ba9c294a0328594"}
Sep 11 12:57:43.548587 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:43.548189    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8"
Sep 11 12:57:43.568077 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:43.568029    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8" podStartSLOduration=1.742987487 podStartE2EDuration="4.568014312s" totalImagesPullingTime="2.825026825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:43.565461332 +0000 UTC m=+627.944987268" watchObservedRunningTime="2026-09-11 12:57:43.568014312 +0000 UTC m=+627.947540247"
Sep 11 12:57:54.554570 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:54.554534    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-9t8p8"
Sep 11 12:57:56.691508 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:56.691467    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"]
Sep 11 12:57:56.695001 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:56.694984    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"
Sep 11 12:57:56.698805 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:56.698783    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9d9r9\""
Sep 11 12:57:56.728207 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:56.728175    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"]
Sep 11 12:57:56.749272 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:56.749238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9snfv\" (UniqueName: \"kubernetes.io/projected/5766aadd-5749-4d77-bd13-850382c36559-kube-api-access-9snfv\") pod \"limitador-operator-controller-manager-74495c69f8-5dbbk\" (UID: \"5766aadd-5749-4d77-bd13-850382c36559\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"
Sep 11 12:57:56.850750 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:56.850709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9snfv\" (UniqueName: \"kubernetes.io/projected/5766aadd-5749-4d77-bd13-850382c36559-kube-api-access-9snfv\") pod \"limitador-operator-controller-manager-74495c69f8-5dbbk\" (UID: \"5766aadd-5749-4d77-bd13-850382c36559\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"
Sep 11 12:57:56.864112 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:56.864088    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9snfv\" (UniqueName: \"kubernetes.io/projected/5766aadd-5749-4d77-bd13-850382c36559-kube-api-access-9snfv\") pod \"limitador-operator-controller-manager-74495c69f8-5dbbk\" (UID: \"5766aadd-5749-4d77-bd13-850382c36559\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"
Sep 11 12:57:57.004616 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:57.004522    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"
Sep 11 12:57:57.291175 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:57.291143    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"]
Sep 11 12:57:57.293361 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:57:57.293308    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5766aadd_5749_4d77_bd13_850382c36559.slice/crio-163a9d9a9624c0c46ebb3721af9b590f9d7d35260743fdc2eb511fd263940c7a WatchSource:0}: Error finding container 163a9d9a9624c0c46ebb3721af9b590f9d7d35260743fdc2eb511fd263940c7a: Status 404 returned error can't find the container with id 163a9d9a9624c0c46ebb3721af9b590f9d7d35260743fdc2eb511fd263940c7a
Sep 11 12:57:57.609778 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:57.609695    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk" event={"ID":"5766aadd-5749-4d77-bd13-850382c36559","Type":"ContainerStarted","Data":"163a9d9a9624c0c46ebb3721af9b590f9d7d35260743fdc2eb511fd263940c7a"}
Sep 11 12:57:59.620221 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:59.620188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk" event={"ID":"5766aadd-5749-4d77-bd13-850382c36559","Type":"ContainerStarted","Data":"3f6f831f241e0b104874d7fca51978c9b7d03fd5ec79aa4ff61b41eba3aa60ad"}
Sep 11 12:57:59.620613 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:59.620248    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"
Sep 11 12:57:59.639474 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:57:59.639426    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk" podStartSLOduration=2.314109514 podStartE2EDuration="3.63941155s" totalImagesPullingTime="1.325302036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:59.637561613 +0000 UTC m=+644.017087562" watchObservedRunningTime="2026-09-11 12:57:59.63941155 +0000 UTC m=+644.018937485"
Sep 11 12:58:10.626830 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:10.626799    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5dbbk"
Sep 11 12:58:25.638162 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.638127    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"]
Sep 11 12:58:25.644631 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.644611    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.646850 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.646827    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fjntr\""
Sep 11 12:58:25.653568 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.653549    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"]
Sep 11 12:58:25.788696 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788666    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f93de5-d236-4d53-923c-b90a2b96647f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.788890 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788706    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.788890 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.788890 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788748    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.788890 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.788890 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.788890 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.789088 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.789088 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.788930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55g95\" (UniqueName: \"kubernetes.io/projected/b5f93de5-d236-4d53-923c-b90a2b96647f-kube-api-access-55g95\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889583 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889583 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889583 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889583 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55g95\" (UniqueName: \"kubernetes.io/projected/b5f93de5-d236-4d53-923c-b90a2b96647f-kube-api-access-55g95\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889893 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889605    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f93de5-d236-4d53-923c-b90a2b96647f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889893 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889893 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889893 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889664    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.889893 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.890166 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.889962    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.890166 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.890016    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.890166 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.890121    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.890166 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.890138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.890394 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.890377    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5f93de5-d236-4d53-923c-b90a2b96647f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.892183 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.892161    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.892421 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.892401    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.898920 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.898894    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55g95\" (UniqueName: \"kubernetes.io/projected/b5f93de5-d236-4d53-923c-b90a2b96647f-kube-api-access-55g95\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.900385 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.900363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f93de5-d236-4d53-923c-b90a2b96647f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-xnnc6\" (UID: \"b5f93de5-d236-4d53-923c-b90a2b96647f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:25.954745 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:25.954720    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:26.237967 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.237945    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"]
Sep 11 12:58:26.240350 ip-10-0-136-247 kubenswrapper[2572]: W0911 12:58:26.240329    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f93de5_d236_4d53_923c_b90a2b96647f.slice/crio-f2f2e4c4d01bcfaa786bfaceaa9d5a212683178b068d6035421ae493b7e8d71c WatchSource:0}: Error finding container f2f2e4c4d01bcfaa786bfaceaa9d5a212683178b068d6035421ae493b7e8d71c: Status 404 returned error can't find the container with id f2f2e4c4d01bcfaa786bfaceaa9d5a212683178b068d6035421ae493b7e8d71c
Sep 11 12:58:26.242169 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.242134    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 12:58:26.242232 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.242217    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 12:58:26.242267 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.242251    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 12:58:26.736721 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.736687    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" event={"ID":"b5f93de5-d236-4d53-923c-b90a2b96647f","Type":"ContainerStarted","Data":"25deca58d9789962294ec879f05ba0d09cb4b7dae41f0ce9fa00ea9208485ae5"}
Sep 11 12:58:26.737115 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.736758    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" event={"ID":"b5f93de5-d236-4d53-923c-b90a2b96647f","Type":"ContainerStarted","Data":"f2f2e4c4d01bcfaa786bfaceaa9d5a212683178b068d6035421ae493b7e8d71c"}
Sep 11 12:58:26.762238 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.762187    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" podStartSLOduration=1.762168046 podStartE2EDuration="1.762168046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:58:26.761588807 +0000 UTC m=+671.141114746" watchObservedRunningTime="2026-09-11 12:58:26.762168046 +0000 UTC m=+671.141693983"
Sep 11 12:58:26.955195 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:26.955157    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:27.959781 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:27.959753    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:28.745238 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:28.745212    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 12:58:28.746136 ip-10-0-136-247 kubenswrapper[2572]: I0911 12:58:28.746120    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 13:00:11.192090 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:11.192057    2572 generic.go:356] "Generic (PLEG): container finished" podID="b5f93de5-d236-4d53-923c-b90a2b96647f" containerID="25deca58d9789962294ec879f05ba0d09cb4b7dae41f0ce9fa00ea9208485ae5" exitCode=0
Sep 11 13:00:11.192497 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:11.192116    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" event={"ID":"b5f93de5-d236-4d53-923c-b90a2b96647f","Type":"ContainerDied","Data":"25deca58d9789962294ec879f05ba0d09cb4b7dae41f0ce9fa00ea9208485ae5"}
Sep 11 13:00:11.192497 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:11.192476    2572 scope.go:117] "RemoveContainer" containerID="25deca58d9789962294ec879f05ba0d09cb4b7dae41f0ce9fa00ea9208485ae5"
Sep 11 13:00:11.195705 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:11.195668    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:00:11.195846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:11.195755    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:00:11.195846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:11.195795    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:00:12.206000 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:12.205954    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" event={"ID":"b5f93de5-d236-4d53-923c-b90a2b96647f","Type":"ContainerStarted","Data":"bcd9adf7fcdfedb0f6e9ab54cc0f6981466296f2275ec19bb43dcf23071f8a5a"}
Sep 11 13:00:12.955482 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:12.955447    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 13:00:12.956451 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:12.956423    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-xnnc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:00:12.956573 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:12.956509    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" podUID="b5f93de5-d236-4d53-923c-b90a2b96647f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 11 13:00:13.745439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:13.745397    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 13:00:13.955214 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:13.955183    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-xnnc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:00:13.955393 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:13.955236    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" podUID="b5f93de5-d236-4d53-923c-b90a2b96647f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 11 13:00:14.955846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:14.955805    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-xnnc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:00:14.956248 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:14.955863    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" podUID="b5f93de5-d236-4d53-923c-b90a2b96647f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 11 13:00:15.955654 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:15.955621    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-xnnc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:00:15.955831 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:15.955671    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" podUID="b5f93de5-d236-4d53-923c-b90a2b96647f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 11 13:00:16.955873 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:16.955834    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-xnnc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:00:16.956262 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:16.955889    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6" podUID="b5f93de5-d236-4d53-923c-b90a2b96647f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 11 13:00:17.959233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:17.959207    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 13:00:17.960247 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:17.960229    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-xnnc6"
Sep 11 13:00:19.014845 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.014816    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"]
Sep 11 13:00:19.017059 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.017041    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.020879 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.020862    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 13:00:19.021671 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.021650    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 13:00:19.021762 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.021671    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gqvhs\""
Sep 11 13:00:19.021762 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.021654    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 13:00:19.031968 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.031948    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"]
Sep 11 13:00:19.175833 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.175805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.175998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.175842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.175998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.175859    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.175998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.175890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzlr\" (UniqueName: \"kubernetes.io/projected/53b3a3ad-1213-4413-b56b-f603c91aff5a-kube-api-access-8hzlr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.175998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.175919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53b3a3ad-1213-4413-b56b-f603c91aff5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.175998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.175949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.276889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.276808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.276889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.276839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.276889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.276860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzlr\" (UniqueName: \"kubernetes.io/projected/53b3a3ad-1213-4413-b56b-f603c91aff5a-kube-api-access-8hzlr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.276889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.276889    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53b3a3ad-1213-4413-b56b-f603c91aff5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.277185 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.276923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.277185 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.276953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.277355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.277308    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.277444 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.277394    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.277444 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.277427    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.279253 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.279226    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53b3a3ad-1213-4413-b56b-f603c91aff5a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.279543 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.279522    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53b3a3ad-1213-4413-b56b-f603c91aff5a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.284875 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.284854    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzlr\" (UniqueName: \"kubernetes.io/projected/53b3a3ad-1213-4413-b56b-f603c91aff5a-kube-api-access-8hzlr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2\" (UID: \"53b3a3ad-1213-4413-b56b-f603c91aff5a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.326804 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.326778    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:19.596900 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.596818    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"]
Sep 11 13:00:19.599618 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:00:19.599583    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b3a3ad_1213_4413_b56b_f603c91aff5a.slice/crio-2e59c204e599d5dccce9c3193661b4e467b96ae0f72459149b707305b22d5a8d WatchSource:0}: Error finding container 2e59c204e599d5dccce9c3193661b4e467b96ae0f72459149b707305b22d5a8d: Status 404 returned error can't find the container with id 2e59c204e599d5dccce9c3193661b4e467b96ae0f72459149b707305b22d5a8d
Sep 11 13:00:19.600903 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:19.600886    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:00:20.244040 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:20.244006    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2" event={"ID":"53b3a3ad-1213-4413-b56b-f603c91aff5a","Type":"ContainerStarted","Data":"2e59c204e599d5dccce9c3193661b4e467b96ae0f72459149b707305b22d5a8d"}
Sep 11 13:00:21.249676 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:21.249640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2" event={"ID":"53b3a3ad-1213-4413-b56b-f603c91aff5a","Type":"ContainerStarted","Data":"e7ac88611246eabec8c3a7f9e11d79f9c3cbff77c41984d25df0f6e1447ffe20"}
Sep 11 13:00:21.271771 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:21.271729    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2" podStartSLOduration=2.268096281 podStartE2EDuration="3.271714698s" totalImagesPullingTime="1.003618417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:21.270254385 +0000 UTC m=+785.649780333" watchObservedRunningTime="2026-09-11 13:00:21.271714698 +0000 UTC m=+785.651240634"
Sep 11 13:00:29.327092 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:29.327056    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:29.327610 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:29.327129    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:29.339467 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:29.339441    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:30.299690 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:30.299661    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2"
Sep 11 13:00:49.101832 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.101745    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"]
Sep 11 13:00:49.103914 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.103891    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.106690 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.106661    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 13:00:49.125296 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.125270    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"]
Sep 11 13:00:49.222096 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.222061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c674837-0e9d-4450-97a1-ef20da77afa3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.222096 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.222099    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.222345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.222126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.222345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.222142    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.222345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.222189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8sd\" (UniqueName: \"kubernetes.io/projected/2c674837-0e9d-4450-97a1-ef20da77afa3-kube-api-access-6q8sd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.222345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.222272    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323212 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c674837-0e9d-4450-97a1-ef20da77afa3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323212 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323215    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323442 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323241    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323442 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323442 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8sd\" (UniqueName: \"kubernetes.io/projected/2c674837-0e9d-4450-97a1-ef20da77afa3-kube-api-access-6q8sd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323551 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323471    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323630    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.323859 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.323839    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.325670 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.325644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c674837-0e9d-4450-97a1-ef20da77afa3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.325895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.325879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c674837-0e9d-4450-97a1-ef20da77afa3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.339084 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.339050    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8sd\" (UniqueName: \"kubernetes.io/projected/2c674837-0e9d-4450-97a1-ef20da77afa3-kube-api-access-6q8sd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g\" (UID: \"2c674837-0e9d-4450-97a1-ef20da77afa3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.416681 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.416654    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:49.695502 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:49.695418    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"]
Sep 11 13:00:49.698777 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:00:49.698747    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c674837_0e9d_4450_97a1_ef20da77afa3.slice/crio-d9913814422eb47c89a0c4368c842cdc0f1ec4849f5531d66e5d9ef120d94902 WatchSource:0}: Error finding container d9913814422eb47c89a0c4368c842cdc0f1ec4849f5531d66e5d9ef120d94902: Status 404 returned error can't find the container with id d9913814422eb47c89a0c4368c842cdc0f1ec4849f5531d66e5d9ef120d94902
Sep 11 13:00:50.376420 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:50.376301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g" event={"ID":"2c674837-0e9d-4450-97a1-ef20da77afa3","Type":"ContainerStarted","Data":"dd05b8b25ae0b43e212702df847311def519792d26d8a9712f1eeb7a115729ee"}
Sep 11 13:00:50.376420 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:50.376375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g" event={"ID":"2c674837-0e9d-4450-97a1-ef20da77afa3","Type":"ContainerStarted","Data":"d9913814422eb47c89a0c4368c842cdc0f1ec4849f5531d66e5d9ef120d94902"}
Sep 11 13:00:50.400988 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:50.400928    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g" podStartSLOduration=1.189772309 podStartE2EDuration="1.400910965s" totalImagesPullingTime="211.138656ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:00:50.399359254 +0000 UTC m=+814.778885193" watchObservedRunningTime="2026-09-11 13:00:50.400910965 +0000 UTC m=+814.780436901"
Sep 11 13:00:59.417334 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:59.417294    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:59.417799 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:59.417365    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:00:59.429834 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:00:59.429805    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:01:00.429646 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:01:00.429619    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g"
Sep 11 13:02:16.087495 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:16.087416    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:02:16.088830 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:16.088807    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:02:45.295158 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.295124    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"]
Sep 11 13:02:45.298177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.298157    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.300498 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.300473    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0e2299-openshift-default-dockercfg-7rdfj\""
Sep 11 13:02:45.311662 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.311624    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"]
Sep 11 13:02:45.449334 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-credential-socket\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449495 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449349    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-podinfo\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449495 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-certs\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449495 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-envoy\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449601 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449514    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-token\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449601 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449545    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istiod-ca-cert\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449601 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449569    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-socket\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-data\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.449733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.449649    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvp2\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-kube-api-access-vnvp2\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.550881 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.550798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-token\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.550881 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.550840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istiod-ca-cert\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.550881 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.550862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-socket\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551149 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.550982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-data\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551205 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551145    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvp2\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-kube-api-access-vnvp2\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551229    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-credential-socket\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-podinfo\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-socket\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-certs\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551496 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551349    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-envoy\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551549 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551512    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-data\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551666 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-certs\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551725 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551691    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istiod-ca-cert\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.551725 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.551706    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-credential-socket\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.553834 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.553806    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-envoy\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.553970 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.553952    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-podinfo\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.559262 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.559240    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-token\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.559403 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.559300    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvp2\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-kube-api-access-vnvp2\") pod \"e2e-inf-a-0e2299-openshift-default-64d674c76-857f5\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") " pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.608678 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.608642    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:45.889694 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.889548    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"]
Sep 11 13:02:45.891986 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:02:45.891961    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd626bdbc_eb78_43d4_8290_ac8c95f4781e.slice/crio-01659fce959e4cfeb1cb1f380689177d303971b8cec28c4c34c006cd632185b3 WatchSource:0}: Error finding container 01659fce959e4cfeb1cb1f380689177d303971b8cec28c4c34c006cd632185b3: Status 404 returned error can't find the container with id 01659fce959e4cfeb1cb1f380689177d303971b8cec28c4c34c006cd632185b3
Sep 11 13:02:45.893995 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.893962    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:45.894100 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.894046    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:45.894100 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:45.894091    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:46.895627 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:46.895591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" event={"ID":"d626bdbc-eb78-43d4-8290-ac8c95f4781e","Type":"ContainerStarted","Data":"3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be"}
Sep 11 13:02:46.896105 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:46.895652    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" event={"ID":"d626bdbc-eb78-43d4-8290-ac8c95f4781e","Type":"ContainerStarted","Data":"01659fce959e4cfeb1cb1f380689177d303971b8cec28c4c34c006cd632185b3"}
Sep 11 13:02:46.933343 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:46.933262    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podStartSLOduration=1.9332402929999999 podStartE2EDuration="1.933240293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:46.93272407 +0000 UTC m=+931.312250006" watchObservedRunningTime="2026-09-11 13:02:46.933240293 +0000 UTC m=+931.312766229"
Sep 11 13:02:47.114130 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.114090    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7806-5a0801"]
Sep 11 13:02:47.117308 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.117284    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:47.129434 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.129411    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-52h42\""
Sep 11 13:02:47.135446 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.135421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7806-5a0801"]
Sep 11 13:02:47.268135 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.268049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbl9\" (UniqueName: \"kubernetes.io/projected/9fdda17e-dad0-454a-a790-41859732efcb-kube-api-access-hzbl9\") pod \"test-curl-7806-5a0801\" (UID: \"9fdda17e-dad0-454a-a790-41859732efcb\") " pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:47.369058 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.369021    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbl9\" (UniqueName: \"kubernetes.io/projected/9fdda17e-dad0-454a-a790-41859732efcb-kube-api-access-hzbl9\") pod \"test-curl-7806-5a0801\" (UID: \"9fdda17e-dad0-454a-a790-41859732efcb\") " pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:47.377298 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.377260    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbl9\" (UniqueName: \"kubernetes.io/projected/9fdda17e-dad0-454a-a790-41859732efcb-kube-api-access-hzbl9\") pod \"test-curl-7806-5a0801\" (UID: \"9fdda17e-dad0-454a-a790-41859732efcb\") " pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:47.427012 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.426983    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:47.609760 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.609658    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:47.614970 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.614944    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:47.697390 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.697349    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7806-5a0801"]
Sep 11 13:02:47.700473 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:02:47.700443    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fdda17e_dad0_454a_a790_41859732efcb.slice/crio-4ef4a78407909b3b40b3d197743e4deb92358a1e2651927f0d0788cea0214140 WatchSource:0}: Error finding container 4ef4a78407909b3b40b3d197743e4deb92358a1e2651927f0d0788cea0214140: Status 404 returned error can't find the container with id 4ef4a78407909b3b40b3d197743e4deb92358a1e2651927f0d0788cea0214140
Sep 11 13:02:47.901312 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.901280    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7806-5a0801" event={"ID":"9fdda17e-dad0-454a-a790-41859732efcb","Type":"ContainerStarted","Data":"4ef4a78407909b3b40b3d197743e4deb92358a1e2651927f0d0788cea0214140"}
Sep 11 13:02:47.905351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.902423    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:47.908054 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:47.908033    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:02:51.922638 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:51.922601    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7806-5a0801" event={"ID":"9fdda17e-dad0-454a-a790-41859732efcb","Type":"ContainerStarted","Data":"4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180"}
Sep 11 13:02:51.941785 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:51.941734    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7806-5a0801" podStartSLOduration=1.567039956 podStartE2EDuration="4.941718652s" totalImagesPullingTime="3.374678696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:51.941098868 +0000 UTC m=+936.320624809" watchObservedRunningTime="2026-09-11 13:02:51.941718652 +0000 UTC m=+936.321244587"
Sep 11 13:02:52.494711 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.494677    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7806-5a0801"]
Sep 11 13:02:52.498656 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.498626    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7806-5a0801"]
Sep 11 13:02:52.609059 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.608973    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7806-18537b"]
Sep 11 13:02:52.609312 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.609300    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fdda17e-dad0-454a-a790-41859732efcb" containerName="test-curl-7806-5a0801"
Sep 11 13:02:52.609312 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.609314    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fdda17e-dad0-454a-a790-41859732efcb" containerName="test-curl-7806-5a0801"
Sep 11 13:02:52.609438 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.609410    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fdda17e-dad0-454a-a790-41859732efcb" containerName="test-curl-7806-5a0801"
Sep 11 13:02:52.612268 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.612248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:52.618398 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.618375    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7806-18537b"]
Sep 11 13:02:52.722809 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.722766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pxbj\" (UniqueName: \"kubernetes.io/projected/7070db2e-db77-44a5-b7dd-0dee2a2d2d7c-kube-api-access-4pxbj\") pod \"test-curl-7806-18537b\" (UID: \"7070db2e-db77-44a5-b7dd-0dee2a2d2d7c\") " pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:52.823491 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.823449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pxbj\" (UniqueName: \"kubernetes.io/projected/7070db2e-db77-44a5-b7dd-0dee2a2d2d7c-kube-api-access-4pxbj\") pod \"test-curl-7806-18537b\" (UID: \"7070db2e-db77-44a5-b7dd-0dee2a2d2d7c\") " pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:52.835076 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.835040    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pxbj\" (UniqueName: \"kubernetes.io/projected/7070db2e-db77-44a5-b7dd-0dee2a2d2d7c-kube-api-access-4pxbj\") pod \"test-curl-7806-18537b\" (UID: \"7070db2e-db77-44a5-b7dd-0dee2a2d2d7c\") " pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:52.922126 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:52.922095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:52.928212 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:52.928187    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7806-5a0801" container="test-curl-7806-5a0801"
Sep 11 13:02:53.194433 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.194306    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7806-18537b"]
Sep 11 13:02:53.197255 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:02:53.197226    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7070db2e_db77_44a5_b7dd_0dee2a2d2d7c.slice/crio-8ab49180c526bb3105e103d0d36e9ccfc109c3c76f86e12926a16ba66fd0602f WatchSource:0}: Error finding container 8ab49180c526bb3105e103d0d36e9ccfc109c3c76f86e12926a16ba66fd0602f: Status 404 returned error can't find the container with id 8ab49180c526bb3105e103d0d36e9ccfc109c3c76f86e12926a16ba66fd0602f
Sep 11 13:02:53.443659 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.443626    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"]
Sep 11 13:02:53.447212 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.447147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.449632 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.449578    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d473235f-openshift-default-dockercfg-d84cb\""
Sep 11 13:02:53.461657 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.461633    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"]
Sep 11 13:02:53.530784 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.530740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413e251f-8f88-4058-b12f-c303ca796a4f-istio-podinfo\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.530960 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.530800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-envoy\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.530960 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.530872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-socket\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.530960 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.530906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-credential-socket\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.530960 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.530926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-istio-token\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.531110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.530961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-certs\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.531110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.530987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-data\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.531110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.531032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413e251f-8f88-4058-b12f-c303ca796a4f-istiod-ca-cert\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.531110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.531087    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkmt9\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-kube-api-access-zkmt9\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632362 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-envoy\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-socket\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632405    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-credential-socket\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632420    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-istio-token\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632456    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-certs\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632473    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-data\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413e251f-8f88-4058-b12f-c303ca796a4f-istiod-ca-cert\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632517    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkmt9\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-kube-api-access-zkmt9\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632938 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413e251f-8f88-4058-b12f-c303ca796a4f-istio-podinfo\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.632938 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.632852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-credential-socket\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.633051 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.633018    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-certs\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.633105 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.633047    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-data\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.633254 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.633236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-socket\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.633489 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.633438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413e251f-8f88-4058-b12f-c303ca796a4f-istiod-ca-cert\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.634897 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.634878    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-envoy\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.635100 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.635084    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413e251f-8f88-4058-b12f-c303ca796a4f-istio-podinfo\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.645782 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.645756    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-istio-token\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.654461 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.654431    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkmt9\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-kube-api-access-zkmt9\") pod \"e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") " pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.759274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.759179    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:53.934511 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.934477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7806-18537b" event={"ID":"7070db2e-db77-44a5-b7dd-0dee2a2d2d7c","Type":"ContainerStarted","Data":"d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1"}
Sep 11 13:02:53.934511 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.934518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7806-18537b" event={"ID":"7070db2e-db77-44a5-b7dd-0dee2a2d2d7c","Type":"ContainerStarted","Data":"8ab49180c526bb3105e103d0d36e9ccfc109c3c76f86e12926a16ba66fd0602f"}
Sep 11 13:02:53.934970 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.934560    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7806-5a0801" podUID="9fdda17e-dad0-454a-a790-41859732efcb" containerName="test-curl-7806-5a0801" containerID="cri-o://4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180" gracePeriod=2
Sep 11 13:02:53.936056 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:53.936034    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7806-5a0801\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="9fdda17e-dad0-454a-a790-41859732efcb" pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:53.955266 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:53.955234    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7806-5a0801\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="9fdda17e-dad0-454a-a790-41859732efcb" pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:53.955801 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:53.955765    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7806-18537b" podStartSLOduration=1.955751136 podStartE2EDuration="1.955751136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:53.953513135 +0000 UTC m=+938.333039071" watchObservedRunningTime="2026-09-11 13:02:53.955751136 +0000 UTC m=+938.335277072"
Sep 11 13:02:54.042635 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.042530    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"]
Sep 11 13:02:54.066131 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.062663    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:54.066131 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.062752    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:54.066131 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.062791    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:54.533468 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.533427    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7806-18537b"]
Sep 11 13:02:54.537240 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.537210    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7806-18537b"]
Sep 11 13:02:54.941109 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.941061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" event={"ID":"413e251f-8f88-4058-b12f-c303ca796a4f","Type":"ContainerStarted","Data":"3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107"}
Sep 11 13:02:54.941555 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.941124    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" event={"ID":"413e251f-8f88-4058-b12f-c303ca796a4f","Type":"ContainerStarted","Data":"1fafd0558346e3fe66d0088c5113fb4e67d6e2d098ccc5d6f6519af43c0f6a23"}
Sep 11 13:02:54.941555 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:54.941265    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7806-18537b" container="test-curl-7806-18537b"
Sep 11 13:02:54.963429 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:54.963376    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podStartSLOduration=1.963360381 podStartE2EDuration="1.963360381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:54.961981093 +0000 UTC m=+939.341507032" watchObservedRunningTime="2026-09-11 13:02:54.963360381 +0000 UTC m=+939.342886316"
Sep 11 13:02:55.316699 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.316620    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"]
Sep 11 13:02:55.317178 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.317161    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" containerName="test-curl-7806-18537b"
Sep 11 13:02:55.317220 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.317182    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" containerName="test-curl-7806-18537b"
Sep 11 13:02:55.317264 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.317257    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" containerName="test-curl-7806-18537b"
Sep 11 13:02:55.320210 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.320194    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.324715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.324690    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-5f1b61-openshift-default-dockercfg-xnn9g\""
Sep 11 13:02:55.339980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.339949    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"]
Sep 11 13:02:55.452150 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452120    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvl9j\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-kube-api-access-lvl9j\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-socket\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452206    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45bdf99-f778-40ac-9956-b9ad028fef98-istiod-ca-cert\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452227    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-credential-socket\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452242    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-token\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452581 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452366    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-podinfo\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452581 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-certs\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452581 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452447    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-envoy\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.452581 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.452488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-data\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553690 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvl9j\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-kube-api-access-lvl9j\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553876 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-socket\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553876 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45bdf99-f778-40ac-9956-b9ad028fef98-istiod-ca-cert\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553876 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-credential-socket\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553876 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553780    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-token\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553876 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553818    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-podinfo\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553876 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-certs\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.553876 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553876    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-envoy\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.554219 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.553908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-data\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.554345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.554294    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-credential-socket\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.554345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.554340    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-socket\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.554541 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.554407    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-certs\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.554541 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.554432    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-data\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.554707 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.554688    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45bdf99-f778-40ac-9956-b9ad028fef98-istiod-ca-cert\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.556528 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.556500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-envoy\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.556683 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.556663    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-podinfo\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.564025 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.563980    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-token\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.564197 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.564177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvl9j\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-kube-api-access-lvl9j\") pod \"e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") " pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.633552 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.633455    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:55.759852 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.759812    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:55.764667 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.764642    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:55.923230 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.919461    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"]
Sep 11 13:02:55.927487 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:02:55.927453    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45bdf99_f778_40ac_9956_b9ad028fef98.slice/crio-5b4bcd7ed1c6785befe72ba103e3206dce76d71cb3efbaf3cde9a4c6025058eb WatchSource:0}: Error finding container 5b4bcd7ed1c6785befe72ba103e3206dce76d71cb3efbaf3cde9a4c6025058eb: Status 404 returned error can't find the container with id 5b4bcd7ed1c6785befe72ba103e3206dce76d71cb3efbaf3cde9a4c6025058eb
Sep 11 13:02:55.929655 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.929623    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:55.929726 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.929689    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:55.929726 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.929714    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:02:55.948218 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.948193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" event={"ID":"e45bdf99-f778-40ac-9956-b9ad028fef98","Type":"ContainerStarted","Data":"5b4bcd7ed1c6785befe72ba103e3206dce76d71cb3efbaf3cde9a4c6025058eb"}
Sep 11 13:02:55.948543 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.948404    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7806-18537b" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" containerName="test-curl-7806-18537b" containerID="cri-o://d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1" gracePeriod=2
Sep 11 13:02:55.948617 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.948597    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:55.949420 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:55.949402    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:02:55.949973 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:55.949951    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7806-18537b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:55.951421 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:55.951399    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7806-18537b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:56.119989 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.119966    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:56.121847 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:56.121823    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7806-18537b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:56.137987 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:56.137952    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7806-18537b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:56.260542 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.260454    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzbl9\" (UniqueName: \"kubernetes.io/projected/9fdda17e-dad0-454a-a790-41859732efcb-kube-api-access-hzbl9\") pod \"9fdda17e-dad0-454a-a790-41859732efcb\" (UID: \"9fdda17e-dad0-454a-a790-41859732efcb\") "
Sep 11 13:02:56.263172 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.263140    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdda17e-dad0-454a-a790-41859732efcb-kube-api-access-hzbl9" (OuterVolumeSpecName: "kube-api-access-hzbl9") pod "9fdda17e-dad0-454a-a790-41859732efcb" (UID: "9fdda17e-dad0-454a-a790-41859732efcb"). InnerVolumeSpecName "kube-api-access-hzbl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:56.361764 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.361730    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzbl9\" (UniqueName: \"kubernetes.io/projected/9fdda17e-dad0-454a-a790-41859732efcb-kube-api-access-hzbl9\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.954424 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.954391    2572 generic.go:356] "Generic (PLEG): container finished" podID="9fdda17e-dad0-454a-a790-41859732efcb" containerID="4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180" exitCode=137
Sep 11 13:02:56.954855 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.954438    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-5a0801"
Sep 11 13:02:56.954855 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.954474    2572 scope.go:117] "RemoveContainer" containerID="4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180"
Sep 11 13:02:56.956266 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.956239    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" event={"ID":"e45bdf99-f778-40ac-9956-b9ad028fef98","Type":"ContainerStarted","Data":"f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9"}
Sep 11 13:02:56.962991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.962971    2572 scope.go:117] "RemoveContainer" containerID="4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180"
Sep 11 13:02:56.963252 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:56.963234    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180\": container with ID starting with 4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180 not found: ID does not exist" containerID="4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180"
Sep 11 13:02:56.963295 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:56.963262    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180"} err="failed to get container status \"4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180\": rpc error: code = NotFound desc = could not find container \"4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180\": container with ID starting with 4b6895b2eec90271b324b796b886faaffa4c0efa9273b8782ad9ec3bf54e4180 not found: ID does not exist"
Sep 11 13:02:57.633772 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:57.633728    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:57.639377 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:57.639352    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:57.665125 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:57.665054    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podStartSLOduration=2.665030662 podStartE2EDuration="2.665030662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:57.012667187 +0000 UTC m=+941.392193124" watchObservedRunningTime="2026-09-11 13:02:57.665030662 +0000 UTC m=+942.044556600"
Sep 11 13:02:57.962981 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:57.962954    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:57.963863 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:57.963847    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:02:58.141722 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.141681    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fdda17e-dad0-454a-a790-41859732efcb" path="/var/lib/kubelet/pods/9fdda17e-dad0-454a-a790-41859732efcb/volumes"
Sep 11 13:02:58.166721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.166699    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:58.280628 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.280549    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pxbj\" (UniqueName: \"kubernetes.io/projected/7070db2e-db77-44a5-b7dd-0dee2a2d2d7c-kube-api-access-4pxbj\") pod \"7070db2e-db77-44a5-b7dd-0dee2a2d2d7c\" (UID: \"7070db2e-db77-44a5-b7dd-0dee2a2d2d7c\") "
Sep 11 13:02:58.282977 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.282952    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7070db2e-db77-44a5-b7dd-0dee2a2d2d7c-kube-api-access-4pxbj" (OuterVolumeSpecName: "kube-api-access-4pxbj") pod "7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" (UID: "7070db2e-db77-44a5-b7dd-0dee2a2d2d7c"). InnerVolumeSpecName "kube-api-access-4pxbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:58.382013 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.381973    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pxbj\" (UniqueName: \"kubernetes.io/projected/7070db2e-db77-44a5-b7dd-0dee2a2d2d7c-kube-api-access-4pxbj\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:02:58.967979 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.967942    2572 generic.go:356] "Generic (PLEG): container finished" podID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" containerID="d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1" exitCode=137
Sep 11 13:02:58.968424 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.967984    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:02:58.968424 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.968042    2572 scope.go:117] "RemoveContainer" containerID="d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1"
Sep 11 13:02:58.976784 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.976767    2572 scope.go:117] "RemoveContainer" containerID="d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1"
Sep 11 13:02:58.977072 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:58.977054    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1\": container with ID starting with d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1 not found: ID does not exist" containerID="d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1"
Sep 11 13:02:58.977134 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:02:58.977080    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1"} err="failed to get container status \"d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1\": rpc error: code = NotFound desc = could not find container \"d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1\": container with ID starting with d8b3f5a75ed8d0f0ceebb3b54d0a5cee47043453cd245f3ae422fd46d2208cf1 not found: ID does not exist"
Sep 11 13:02:58.980651 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:02:58.980627    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7806-18537b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" pod="opendatahub/test-curl-7806-18537b"
Sep 11 13:03:00.139789 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:00.139758    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7070db2e-db77-44a5-b7dd-0dee2a2d2d7c" path="/var/lib/kubelet/pods/7070db2e-db77-44a5-b7dd-0dee2a2d2d7c/volumes"
Sep 11 13:03:08.023474 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:08.023372    2572 generic.go:356] "Generic (PLEG): container finished" podID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerID="3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be" exitCode=0
Sep 11 13:03:08.023474 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:08.023440    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" event={"ID":"d626bdbc-eb78-43d4-8290-ac8c95f4781e","Type":"ContainerDied","Data":"3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be"}
Sep 11 13:03:08.024047 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:08.023954    2572 scope.go:117] "RemoveContainer" containerID="3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be"
Sep 11 13:03:08.025404 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:08.025348    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:08.025516 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:08.025452    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:08.025516 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:08.025503    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:09.032787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:09.032751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" event={"ID":"d626bdbc-eb78-43d4-8290-ac8c95f4781e","Type":"ContainerStarted","Data":"8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6"}
Sep 11 13:03:09.608879 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:09.608833    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:03:09.609765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:09.609725    2572 patch_prober.go:28] interesting pod/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:03:09.610037 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:09.610006    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 11 13:03:10.609863 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:10.609811    2572 patch_prober.go:28] interesting pod/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:03:10.610436 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:10.609888    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 11 13:03:11.609805 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:11.609759    2572 patch_prober.go:28] interesting pod/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:03:11.610011 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:11.609832    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 11 13:03:12.610196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:12.610003    2572 patch_prober.go:28] interesting pod/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:03:12.610196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:12.610069    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 11 13:03:13.610185 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:13.610142    2572 patch_prober.go:28] interesting pod/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:03:13.610392 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:13.610220    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 11 13:03:14.004604 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.004552    2572 patch_prober.go:28] interesting pod/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:03:14.004822 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.004637    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:03:14.548804 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.548772    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"]
Sep 11 13:03:14.552533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.552510    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.554922 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.554903    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-de3842-openshift-default-dockercfg-7pq4b\""
Sep 11 13:03:14.566783 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.566757    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"]
Sep 11 13:03:14.613735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.613689    2572 patch_prober.go:28] interesting pod/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:03:14.614225 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.613750    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 11 13:03:14.673350 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673293    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-socket\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673544 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-data\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673544 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-podinfo\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673544 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673400    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnq7n\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-kube-api-access-bnq7n\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673544 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-token\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673761 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-certs\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673761 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-envoy\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673761 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istiod-ca-cert\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.673761 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.673727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-credential-socket\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775155 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-certs\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775155 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-envoy\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775198    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istiod-ca-cert\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-credential-socket\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775416    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-socket\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775443    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-data\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-podinfo\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnq7n\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-kube-api-access-bnq7n\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-token\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775967 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775687    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-certs\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.775967 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.775820    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-socket\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.776159 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.776120    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-data\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.776262 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.776192    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-credential-socket\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.776366 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.776277    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istiod-ca-cert\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.777908 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.777755    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-envoy\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.778464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.778447    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-podinfo\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.792397 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.791037    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnq7n\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-kube-api-access-bnq7n\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.792397 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.791492    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-token\") pod \"e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") " pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:14.866147 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:14.866062    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:15.164824 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:15.164793    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"]
Sep 11 13:03:15.166846 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:03:15.166813    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc432ec3a_4df6_4fb2_ad44_50a2e56af285.slice/crio-28f1a746bece002762f8336d2d06e3aa9384383e5f6aebad00debb030fc32c97 WatchSource:0}: Error finding container 28f1a746bece002762f8336d2d06e3aa9384383e5f6aebad00debb030fc32c97: Status 404 returned error can't find the container with id 28f1a746bece002762f8336d2d06e3aa9384383e5f6aebad00debb030fc32c97
Sep 11 13:03:15.169624 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:15.169579    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:15.169709 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:15.169678    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:15.169760 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:15.169724    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:15.612981 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:15.612901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:03:15.613212 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:15.613186    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:03:15.613828 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:15.613809    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:03:16.082659 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.082568    2572 generic.go:356] "Generic (PLEG): container finished" podID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerID="f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9" exitCode=0
Sep 11 13:03:16.082659 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.082654    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" event={"ID":"e45bdf99-f778-40ac-9956-b9ad028fef98","Type":"ContainerDied","Data":"f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9"}
Sep 11 13:03:16.083184 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.083160    2572 scope.go:117] "RemoveContainer" containerID="f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9"
Sep 11 13:03:16.084428 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.084393    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:16.084549 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.084472    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:16.084549 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.084517    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:16.084901 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.084871    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" event={"ID":"c432ec3a-4df6-4fb2-ad44-50a2e56af285","Type":"ContainerStarted","Data":"44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4"}
Sep 11 13:03:16.085002 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.084920    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" event={"ID":"c432ec3a-4df6-4fb2-ad44-50a2e56af285","Type":"ContainerStarted","Data":"28f1a746bece002762f8336d2d06e3aa9384383e5f6aebad00debb030fc32c97"}
Sep 11 13:03:16.086625 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.086604    2572 generic.go:356] "Generic (PLEG): container finished" podID="413e251f-8f88-4058-b12f-c303ca796a4f" containerID="3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107" exitCode=0
Sep 11 13:03:16.086706 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.086679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" event={"ID":"413e251f-8f88-4058-b12f-c303ca796a4f","Type":"ContainerDied","Data":"3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107"}
Sep 11 13:03:16.087193 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.087175    2572 scope.go:117] "RemoveContainer" containerID="3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107"
Sep 11 13:03:16.088289 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.088216    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:16.088384 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.088296    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:16.088384 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.088369    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:16.151431 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.151378    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" podStartSLOduration=2.151355654 podStartE2EDuration="2.151355654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:16.150259936 +0000 UTC m=+960.529785873" watchObservedRunningTime="2026-09-11 13:03:16.151355654 +0000 UTC m=+960.530881591"
Sep 11 13:03:16.866557 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.866517    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:16.871846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:16.871819    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:17.097014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.096970    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" event={"ID":"413e251f-8f88-4058-b12f-c303ca796a4f","Type":"ContainerStarted","Data":"e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f"}
Sep 11 13:03:17.101993 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.101934    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" event={"ID":"e45bdf99-f778-40ac-9956-b9ad028fef98","Type":"ContainerStarted","Data":"1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726"}
Sep 11 13:03:17.102949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.102910    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:17.110646 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.110608    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:17.633943 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.633902    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:03:17.634165 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.634032    2572 patch_prober.go:28] interesting pod/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:03:17.634165 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.634077    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 13:03:17.759661 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.759631    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:03:17.759964 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.759947    2572 patch_prober.go:28] interesting pod/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:03:17.760090 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:17.760068    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 11 13:03:18.634709 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:18.634660    2572 patch_prober.go:28] interesting pod/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:03:18.635467 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:18.635424    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 13:03:18.760100 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:18.760070    2572 patch_prober.go:28] interesting pod/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:03:18.760413 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:18.760387    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 11 13:03:19.635345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:19.634856    2572 patch_prober.go:28] interesting pod/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:03:19.635345 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:19.634947    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 13:03:19.760431 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:19.760396    2572 patch_prober.go:28] interesting pod/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:03:19.760616 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:19.760460    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 11 13:03:20.380090 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.379866    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"]
Sep 11 13:03:20.383566 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.383544    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.389351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.388038    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-de3842-dockercfg-7tktt\""
Sep 11 13:03:20.389351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.388313    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-de3842\""
Sep 11 13:03:20.416029 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.415982    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"]
Sep 11 13:03:20.556031 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.555991    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plv57\" (UniqueName: \"kubernetes.io/projected/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-kube-api-access-plv57\") pod \"payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.556298 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.556275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.634111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.634003    2572 patch_prober.go:28] interesting pod/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:03:20.634111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.634078    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 13:03:20.657173 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.657136    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plv57\" (UniqueName: \"kubernetes.io/projected/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-kube-api-access-plv57\") pod \"payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.657647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.657190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.658026 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.658004    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.665252 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.665229    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plv57\" (UniqueName: \"kubernetes.io/projected/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-kube-api-access-plv57\") pod \"payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.703083 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.703049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:20.760513 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.760484    2572 patch_prober.go:28] interesting pod/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:03:20.760735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:20.760715    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 11 13:03:21.007901 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.007856    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"]
Sep 11 13:03:21.010591 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:03:21.010547    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a78206_8a17_47a8_b7b0_7a3b7ba09138.slice/crio-0b9a84f9259aaaefeabb829a644703b2cdca72cdd935166aebb1d7ab272c5dfa WatchSource:0}: Error finding container 0b9a84f9259aaaefeabb829a644703b2cdca72cdd935166aebb1d7ab272c5dfa: Status 404 returned error can't find the container with id 0b9a84f9259aaaefeabb829a644703b2cdca72cdd935166aebb1d7ab272c5dfa
Sep 11 13:03:21.133700 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.133661    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2" event={"ID":"d3a78206-8a17-47a8-b7b0-7a3b7ba09138","Type":"ContainerStarted","Data":"0b9a84f9259aaaefeabb829a644703b2cdca72cdd935166aebb1d7ab272c5dfa"}
Sep 11 13:03:21.636813 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.636767    2572 patch_prober.go:28] interesting pod/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:03:21.637017 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.636834    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 11 13:03:21.759946 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.759902    2572 patch_prober.go:28] interesting pod/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:03:21.760440 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.759979    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 11 13:03:21.854996 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.854958    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"]
Sep 11 13:03:21.857606 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.857585    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"
Sep 11 13:03:21.860073 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.859802    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:03:21.860073 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.860071    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:03:21.867236 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.867211    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"]
Sep 11 13:03:21.972284 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:21.972149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/314eccd1-01ea-4e9a-ab6f-00437e70e747-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d473235f-dtbtj\" (UID: \"314eccd1-01ea-4e9a-ab6f-00437e70e747\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"
Sep 11 13:03:22.074015 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.073889    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/314eccd1-01ea-4e9a-ab6f-00437e70e747-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d473235f-dtbtj\" (UID: \"314eccd1-01ea-4e9a-ab6f-00437e70e747\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"
Sep 11 13:03:22.074623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.074596    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/314eccd1-01ea-4e9a-ab6f-00437e70e747-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d473235f-dtbtj\" (UID: \"314eccd1-01ea-4e9a-ab6f-00437e70e747\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"
Sep 11 13:03:22.172555 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.172442    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"
Sep 11 13:03:22.497466 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.497371    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"]
Sep 11 13:03:22.639191 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.639147    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:03:22.639669 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.639632    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:03:22.640597 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.640575    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:03:22.760086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.760050    2572 patch_prober.go:28] interesting pod/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:03:22.760545 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:22.760114    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 11 13:03:23.163385 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:23.163351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj" event={"ID":"314eccd1-01ea-4e9a-ab6f-00437e70e747","Type":"ContainerStarted","Data":"074bd7a7ad9f346ed399bbab5d4a84806456d617dc111ce5d67b0c7f13a66701"}
Sep 11 13:03:23.764180 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:23.764151    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:03:23.764642 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:23.764552    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:03:23.765265 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:23.765245    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:03:24.172021 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:24.171984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2" event={"ID":"d3a78206-8a17-47a8-b7b0-7a3b7ba09138","Type":"ContainerStarted","Data":"f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec"}
Sep 11 13:03:24.172660 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:24.172633    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:24.190099 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:24.190045    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2" podStartSLOduration=1.36055566 podStartE2EDuration="4.190030018s" totalImagesPullingTime="2.829474358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:24.18802996 +0000 UTC m=+968.567555898" watchObservedRunningTime="2026-09-11 13:03:24.190030018 +0000 UTC m=+968.569555953"
Sep 11 13:03:26.184821 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:26.184787    2572 generic.go:356] "Generic (PLEG): container finished" podID="314eccd1-01ea-4e9a-ab6f-00437e70e747" containerID="55e87d658374df553537032de6443cbd0bdf575aa02222d274262d37fafd350c" exitCode=0
Sep 11 13:03:26.185213 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:26.184821    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj" event={"ID":"314eccd1-01ea-4e9a-ab6f-00437e70e747","Type":"ContainerDied","Data":"55e87d658374df553537032de6443cbd0bdf575aa02222d274262d37fafd350c"}
Sep 11 13:03:27.327936 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:27.327908    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"
Sep 11 13:03:27.430494 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:27.430461    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/314eccd1-01ea-4e9a-ab6f-00437e70e747-maas-api-service-ca\") pod \"314eccd1-01ea-4e9a-ab6f-00437e70e747\" (UID: \"314eccd1-01ea-4e9a-ab6f-00437e70e747\") "
Sep 11 13:03:27.430835 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:27.430812    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/314eccd1-01ea-4e9a-ab6f-00437e70e747-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "314eccd1-01ea-4e9a-ab6f-00437e70e747" (UID: "314eccd1-01ea-4e9a-ab6f-00437e70e747"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:03:27.532292 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:27.532210    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/314eccd1-01ea-4e9a-ab6f-00437e70e747-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:28.196460 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:28.196421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj" event={"ID":"314eccd1-01ea-4e9a-ab6f-00437e70e747","Type":"ContainerDied","Data":"074bd7a7ad9f346ed399bbab5d4a84806456d617dc111ce5d67b0c7f13a66701"}
Sep 11 13:03:28.196631 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:28.196474    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="074bd7a7ad9f346ed399bbab5d4a84806456d617dc111ce5d67b0c7f13a66701"
Sep 11 13:03:28.196631 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:28.196438    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"
Sep 11 13:03:36.187879 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:36.187847    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:03:38.716853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:38.716817    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"]
Sep 11 13:03:38.721607 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:38.721570    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d473235f-dtbtj"]
Sep 11 13:03:38.855031 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:38.854995    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"]
Sep 11 13:03:38.855334 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:38.855289    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy" containerID="cri-o://e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f" gracePeriod=30
Sep 11 13:03:39.250769 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.250743    2572 generic.go:356] "Generic (PLEG): container finished" podID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerID="44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4" exitCode=0
Sep 11 13:03:39.250914 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.250815    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" event={"ID":"c432ec3a-4df6-4fb2-ad44-50a2e56af285","Type":"ContainerDied","Data":"44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4"}
Sep 11 13:03:39.251248 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.251232    2572 scope.go:117] "RemoveContainer" containerID="44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4"
Sep 11 13:03:39.252286 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.252261    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:39.252355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.252341    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:39.252394 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.252377    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:39.877276 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.877234    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"]
Sep 11 13:03:39.877862 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.877831    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314eccd1-01ea-4e9a-ab6f-00437e70e747" containerName="revoke-keys"
Sep 11 13:03:39.877862 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.877856    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="314eccd1-01ea-4e9a-ab6f-00437e70e747" containerName="revoke-keys"
Sep 11 13:03:39.878029 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.877967    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="314eccd1-01ea-4e9a-ab6f-00437e70e747" containerName="revoke-keys"
Sep 11 13:03:39.880257 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.880237    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:39.882490 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.882471    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6a731442-gw-openshift-default-dockercfg-sqf8v\""
Sep 11 13:03:39.893097 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:39.893071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"]
Sep 11 13:03:40.050550 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050516    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-socket\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050771 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050597    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-token\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050771 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050621    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-certs\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050771 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-envoy\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050771 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istiod-ca-cert\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050771 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050763    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-credential-socket\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050971 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050780    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6l8v\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-kube-api-access-l6l8v\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050971 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-podinfo\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.050971 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.050815    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-data\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.140594 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.140513    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="314eccd1-01ea-4e9a-ab6f-00437e70e747" path="/var/lib/kubelet/pods/314eccd1-01ea-4e9a-ab6f-00437e70e747/volumes"
Sep 11 13:03:40.151336 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-envoy\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istiod-ca-cert\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151395    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-credential-socket\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151414    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6l8v\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-kube-api-access-l6l8v\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151436    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-podinfo\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-data\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151762 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151612    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-socket\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151762 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-token\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151873 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151772    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-certs\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.151873 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.151832    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-credential-socket\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.152185 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.152162    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-data\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.152425 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.152405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-certs\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.152512 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.152494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istiod-ca-cert\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.152565 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.152542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-socket\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.153926 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.153909    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-envoy\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.154093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.154079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-podinfo\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.159755 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.159730    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-token\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.159867 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.159851    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6l8v\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-kube-api-access-l6l8v\") pod \"e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") " pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.197986 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.197934    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:40.261508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.261477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" event={"ID":"c432ec3a-4df6-4fb2-ad44-50a2e56af285","Type":"ContainerStarted","Data":"3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852"}
Sep 11 13:03:40.490918 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.490879    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"]
Sep 11 13:03:40.509687 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:03:40.509649    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf68ee3_dd4e_4d7a_83da_de03876a5d34.slice/crio-b39b09c43514de7f6dea0dc28c6c93bf9bb8573d46ec2e737bf44de650d10017 WatchSource:0}: Error finding container b39b09c43514de7f6dea0dc28c6c93bf9bb8573d46ec2e737bf44de650d10017: Status 404 returned error can't find the container with id b39b09c43514de7f6dea0dc28c6c93bf9bb8573d46ec2e737bf44de650d10017
Sep 11 13:03:40.512436 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.511696    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:40.512436 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.511790    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:40.512436 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.511857    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:03:40.866858 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.866772    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:40.867030 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.866939    2572 patch_prober.go:28] interesting pod/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:03:40.867030 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:40.866980    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:03:41.268260 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:41.268220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" event={"ID":"3cf68ee3-dd4e-4d7a-83da-de03876a5d34","Type":"ContainerStarted","Data":"3ee946130723315ddd3f702ab10e402efe9f99253beb82947cd5c28d2f2469c1"}
Sep 11 13:03:41.268725 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:41.268311    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" event={"ID":"3cf68ee3-dd4e-4d7a-83da-de03876a5d34","Type":"ContainerStarted","Data":"b39b09c43514de7f6dea0dc28c6c93bf9bb8573d46ec2e737bf44de650d10017"}
Sep 11 13:03:41.289117 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:41.289048    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" podStartSLOduration=2.289025245 podStartE2EDuration="2.289025245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:41.286913383 +0000 UTC m=+985.666439320" watchObservedRunningTime="2026-09-11 13:03:41.289025245 +0000 UTC m=+985.668551183"
Sep 11 13:03:41.866615 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:41.866576    2572 patch_prober.go:28] interesting pod/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:03:41.866799 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:41.866632    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:03:42.200393 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:42.200356    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:42.211048 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:42.211014    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:42.273612 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:42.273585    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:42.274665 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:42.274647    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:03:42.867036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:42.867001    2572 patch_prober.go:28] interesting pod/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:03:42.867210 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:42.867057    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:03:43.867284 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:43.867250    2572 patch_prober.go:28] interesting pod/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:03:43.867764 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:43.867302    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:03:44.181860 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.181836    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211296    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413e251f-8f88-4058-b12f-c303ca796a4f-istiod-ca-cert\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211440    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-envoy\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211472    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-socket\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211517    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-credential-socket\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211551    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-data\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211608    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkmt9\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-kube-api-access-zkmt9\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211639    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413e251f-8f88-4058-b12f-c303ca796a4f-istio-podinfo\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211681    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-istio-token\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.212355 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.211747    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-certs\") pod \"413e251f-8f88-4058-b12f-c303ca796a4f\" (UID: \"413e251f-8f88-4058-b12f-c303ca796a4f\") "
Sep 11 13:03:44.214227 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.213161    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:03:44.214227 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.213462    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413e251f-8f88-4058-b12f-c303ca796a4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:03:44.214227 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.213948    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:03:44.214579 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.214541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:03:44.229346 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.225457    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/413e251f-8f88-4058-b12f-c303ca796a4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:03:44.229923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.229862    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:03:44.230033 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.229952    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:03:44.230708 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.230672    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:03:44.232743 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.232714    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-kube-api-access-zkmt9" (OuterVolumeSpecName: "kube-api-access-zkmt9") pod "413e251f-8f88-4058-b12f-c303ca796a4f" (UID: "413e251f-8f88-4058-b12f-c303ca796a4f"). InnerVolumeSpecName "kube-api-access-zkmt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:03:44.300086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.300042    2572 generic.go:356] "Generic (PLEG): container finished" podID="413e251f-8f88-4058-b12f-c303ca796a4f" containerID="e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f" exitCode=0
Sep 11 13:03:44.300944 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.300919    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"
Sep 11 13:03:44.312612 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.312568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" event={"ID":"413e251f-8f88-4058-b12f-c303ca796a4f","Type":"ContainerDied","Data":"e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f"}
Sep 11 13:03:44.312767 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.312648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj" event={"ID":"413e251f-8f88-4058-b12f-c303ca796a4f","Type":"ContainerDied","Data":"1fafd0558346e3fe66d0088c5113fb4e67d6e2d098ccc5d6f6519af43c0f6a23"}
Sep 11 13:03:44.312767 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.312682    2572 scope.go:117] "RemoveContainer" containerID="e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f"
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313523    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313554    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413e251f-8f88-4058-b12f-c303ca796a4f-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313566    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313579    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313592    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313607    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413e251f-8f88-4058-b12f-c303ca796a4f-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313622    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkmt9\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-kube-api-access-zkmt9\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313635    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413e251f-8f88-4058-b12f-c303ca796a4f-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.314129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.313647    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413e251f-8f88-4058-b12f-c303ca796a4f-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:03:44.336261 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.335918    2572 scope.go:117] "RemoveContainer" containerID="3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107"
Sep 11 13:03:44.347785 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.347761    2572 scope.go:117] "RemoveContainer" containerID="e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f"
Sep 11 13:03:44.348203 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:03:44.348176    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f\": container with ID starting with e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f not found: ID does not exist" containerID="e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f"
Sep 11 13:03:44.348274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.348217    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f"} err="failed to get container status \"e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f\": rpc error: code = NotFound desc = could not find container \"e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f\": container with ID starting with e49f3696f5a505b3dfb8e6cee653093d326fab5af10397c088584bd2dc21296f not found: ID does not exist"
Sep 11 13:03:44.348274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.348244    2572 scope.go:117] "RemoveContainer" containerID="3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107"
Sep 11 13:03:44.348765 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:03:44.348737    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107\": container with ID starting with 3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107 not found: ID does not exist" containerID="3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107"
Sep 11 13:03:44.348874 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.348771    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107"} err="failed to get container status \"3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107\": rpc error: code = NotFound desc = could not find container \"3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107\": container with ID starting with 3b6344223826b7eca2f66501779d82cb78219fac597b429784fa9a7e07106107 not found: ID does not exist"
Sep 11 13:03:44.350192 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.350169    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"]
Sep 11 13:03:44.354489 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.354469    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d473235f-openshift-default-7bd7ccc988-55qzj"]
Sep 11 13:03:44.867464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.867431    2572 patch_prober.go:28] interesting pod/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:03:44.867852 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:44.867489    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:03:45.871123 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:45.871092    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:45.871602 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:45.871530    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:45.872133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:45.872117    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:03:46.140382 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:46.140291    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" path="/var/lib/kubelet/pods/413e251f-8f88-4058-b12f-c303ca796a4f/volumes"
Sep 11 13:03:58.699733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.699692    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"]
Sep 11 13:03:58.700311 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.700290    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy"
Sep 11 13:03:58.700379 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.700340    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy"
Sep 11 13:03:58.700485 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.700473    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy"
Sep 11 13:03:58.700519 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.700493    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy"
Sep 11 13:03:58.706375 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.706355    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.710733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.709920    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-5f1b61\"/\"kube-root-ca.crt\""
Sep 11 13:03:58.710733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.710157    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-5f1b61\"/\"openshift-service-ca.crt\""
Sep 11 13:03:58.710733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.710385    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-5f1b61\"/\"autores-model-5f1b61-kserve-self-signed-certs\""
Sep 11 13:03:58.710733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.710582    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-5f1b61\"/\"default-dockercfg-k468j\""
Sep 11 13:03:58.712847 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.712821    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"]
Sep 11 13:03:58.759122 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.759085    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c338088-4034-40bd-a9d1-abb28d254e72-tls-certs\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.759122 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.759127    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-home\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.759406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.759175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-tmp-dir\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.759406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.759301    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-model-cache\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.759406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.759377    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-dshm\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.759550 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.759436    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lt2\" (UniqueName: \"kubernetes.io/projected/5c338088-4034-40bd-a9d1-abb28d254e72-kube-api-access-p8lt2\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.860282 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.860239    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lt2\" (UniqueName: \"kubernetes.io/projected/5c338088-4034-40bd-a9d1-abb28d254e72-kube-api-access-p8lt2\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.860493 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.860298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c338088-4034-40bd-a9d1-abb28d254e72-tls-certs\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.860493 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.860365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-home\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.860493 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.860447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-tmp-dir\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.860663 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.860547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-model-cache\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.860663 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.860576    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-dshm\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.860938 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.860884    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-tmp-dir\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.861084 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.861027    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-model-cache\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.861454 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.861430    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-home\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.863200 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.863176    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-dshm\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.863416 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.863398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c338088-4034-40bd-a9d1-abb28d254e72-tls-certs\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:58.881005 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:58.880974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lt2\" (UniqueName: \"kubernetes.io/projected/5c338088-4034-40bd-a9d1-abb28d254e72-kube-api-access-p8lt2\") pod \"autores-model-5f1b61-kserve-7b96fd494c-k7z9d\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") " pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:59.018661 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:59.018559    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:03:59.298014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:59.297984    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"]
Sep 11 13:03:59.300209 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:03:59.300175    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c338088_4034_40bd_a9d1_abb28d254e72.slice/crio-8ecde288fa33449bacd0a0f7bc34a2946ed0dbd908c06522484a8f99f5d46261 WatchSource:0}: Error finding container 8ecde288fa33449bacd0a0f7bc34a2946ed0dbd908c06522484a8f99f5d46261: Status 404 returned error can't find the container with id 8ecde288fa33449bacd0a0f7bc34a2946ed0dbd908c06522484a8f99f5d46261
Sep 11 13:03:59.379196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:59.379157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d" event={"ID":"5c338088-4034-40bd-a9d1-abb28d254e72","Type":"ContainerStarted","Data":"f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933"}
Sep 11 13:03:59.379453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:59.379205    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d" event={"ID":"5c338088-4034-40bd-a9d1-abb28d254e72","Type":"ContainerStarted","Data":"8ecde288fa33449bacd0a0f7bc34a2946ed0dbd908c06522484a8f99f5d46261"}
Sep 11 13:03:59.399931 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:03:59.399882    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d" podStartSLOduration=1.399864718 podStartE2EDuration="1.399864718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:59.397722529 +0000 UTC m=+1003.777248465" watchObservedRunningTime="2026-09-11 13:03:59.399864718 +0000 UTC m=+1003.779390681"
Sep 11 13:04:02.396540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:02.396511    2572 generic.go:356] "Generic (PLEG): container finished" podID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerID="3ee946130723315ddd3f702ab10e402efe9f99253beb82947cd5c28d2f2469c1" exitCode=0
Sep 11 13:04:02.396976 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:02.396547    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" event={"ID":"3cf68ee3-dd4e-4d7a-83da-de03876a5d34","Type":"ContainerDied","Data":"3ee946130723315ddd3f702ab10e402efe9f99253beb82947cd5c28d2f2469c1"}
Sep 11 13:04:02.396976 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:02.396898    2572 scope.go:117] "RemoveContainer" containerID="3ee946130723315ddd3f702ab10e402efe9f99253beb82947cd5c28d2f2469c1"
Sep 11 13:04:02.398010 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:02.397982    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:02.398079 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:02.398050    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:02.398121 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:02.398079    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:03.407729 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:03.407694    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" event={"ID":"3cf68ee3-dd4e-4d7a-83da-de03876a5d34","Type":"ContainerStarted","Data":"ebbeebb918ec195d551e34b2ae07a2dba7e209e8108188041122ef47c79e5b6a"}
Sep 11 13:04:04.199403 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:04.199365    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:04:04.199765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:04.199740    2572 patch_prober.go:28] interesting pod/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:04:04.199954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:04.199925    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 13:04:04.997219 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:04.997168    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"]
Sep 11 13:04:04.997949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:04.997924    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy"
Sep 11 13:04:04.998047 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:04.997968    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="413e251f-8f88-4058-b12f-c303ca796a4f" containerName="istio-proxy"
Sep 11 13:04:05.000713 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.000689    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.003148 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.003118    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-b18cb0e6-kserve-self-signed-certs\""
Sep 11 13:04:05.013814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.013773    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"]
Sep 11 13:04:05.124066 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.124036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4929dba-45cd-43e6-8945-2dd227637326-tls-certs\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.124277 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.124112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nnm8\" (UniqueName: \"kubernetes.io/projected/c4929dba-45cd-43e6-8945-2dd227637326-kube-api-access-9nnm8\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.124277 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.124168    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-dshm\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.124277 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.124209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-home\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.124277 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.124240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-model-cache\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.124277 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.124264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-tmp-dir\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.199338 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.199270    2572 patch_prober.go:28] interesting pod/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:04:05.199670 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.199618    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 13:04:05.225428 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.225400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nnm8\" (UniqueName: \"kubernetes.io/projected/c4929dba-45cd-43e6-8945-2dd227637326-kube-api-access-9nnm8\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.225667 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.225653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-dshm\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.225798 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.225787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-home\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.225906 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.225897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-model-cache\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.226011 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.226001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-tmp-dir\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.226156 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.226122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4929dba-45cd-43e6-8945-2dd227637326-tls-certs\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.226311 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.226281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-tmp-dir\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.226402 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.226234    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-model-cache\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.226402 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.226147    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-home\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.228346 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.228306    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-dshm\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.228562 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.228547    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4929dba-45cd-43e6-8945-2dd227637326-tls-certs\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.234693 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.234671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nnm8\" (UniqueName: \"kubernetes.io/projected/c4929dba-45cd-43e6-8945-2dd227637326-kube-api-access-9nnm8\") pod \"e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") " pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.327026 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.326900    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:05.624019 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:05.623927    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"]
Sep 11 13:04:05.626942 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:04:05.626912    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4929dba_45cd_43e6_8945_2dd227637326.slice/crio-6131dd77800e897b84aa45be16da0cf32ed5a3e208f5786c9d4e0ac1f0c6d7c0 WatchSource:0}: Error finding container 6131dd77800e897b84aa45be16da0cf32ed5a3e208f5786c9d4e0ac1f0c6d7c0: Status 404 returned error can't find the container with id 6131dd77800e897b84aa45be16da0cf32ed5a3e208f5786c9d4e0ac1f0c6d7c0
Sep 11 13:04:06.199149 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:06.199108    2572 patch_prober.go:28] interesting pod/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:04:06.199784 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:06.199749    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 13:04:06.428580 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:06.428545    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc" event={"ID":"c4929dba-45cd-43e6-8945-2dd227637326","Type":"ContainerStarted","Data":"a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573"}
Sep 11 13:04:06.428749 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:06.428588    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc" event={"ID":"c4929dba-45cd-43e6-8945-2dd227637326","Type":"ContainerStarted","Data":"6131dd77800e897b84aa45be16da0cf32ed5a3e208f5786c9d4e0ac1f0c6d7c0"}
Sep 11 13:04:06.447337 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:06.447271    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc" podStartSLOduration=2.447255466 podStartE2EDuration="2.447255466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:06.445728647 +0000 UTC m=+1010.825254585" watchObservedRunningTime="2026-09-11 13:04:06.447255466 +0000 UTC m=+1010.826781438"
Sep 11 13:04:07.198967 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.198928    2572 patch_prober.go:28] interesting pod/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:04:07.199297 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.199264    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 13:04:07.807758 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.807715    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"]
Sep 11 13:04:07.814165 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.814131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"
Sep 11 13:04:07.817525 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.817501    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:04:07.817781 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.817629    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:04:07.820187 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.820162    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"]
Sep 11 13:04:07.950815 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:07.950766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd176afb-c262-454f-88b9-b86820ec5eeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6a731442-p88gn\" (UID: \"fd176afb-c262-454f-88b9-b86820ec5eeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"
Sep 11 13:04:08.052195 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:08.052156    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd176afb-c262-454f-88b9-b86820ec5eeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6a731442-p88gn\" (UID: \"fd176afb-c262-454f-88b9-b86820ec5eeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"
Sep 11 13:04:08.052834 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:08.052811    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd176afb-c262-454f-88b9-b86820ec5eeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-6a731442-p88gn\" (UID: \"fd176afb-c262-454f-88b9-b86820ec5eeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"
Sep 11 13:04:08.128221 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:08.128137    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"
Sep 11 13:04:08.199824 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:08.199784    2572 patch_prober.go:28] interesting pod/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:04:08.200387 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:08.200355    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 13:04:08.405173 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:08.405146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"]
Sep 11 13:04:08.407477 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:04:08.407442    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd176afb_c262_454f_88b9_b86820ec5eeb.slice/crio-89e069820550691be4ec9698c9565305c31f234c845715fe79ae248e82fb054f WatchSource:0}: Error finding container 89e069820550691be4ec9698c9565305c31f234c845715fe79ae248e82fb054f: Status 404 returned error can't find the container with id 89e069820550691be4ec9698c9565305c31f234c845715fe79ae248e82fb054f
Sep 11 13:04:08.441834 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:08.441797    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn" event={"ID":"fd176afb-c262-454f-88b9-b86820ec5eeb","Type":"ContainerStarted","Data":"89e069820550691be4ec9698c9565305c31f234c845715fe79ae248e82fb054f"}
Sep 11 13:04:09.019814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.019711    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:04:09.019814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.019777    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:04:09.032444 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.032415    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:04:09.203036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.203005    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:04:09.203437 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.203417    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:04:09.204101 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.204081    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:04:09.448489 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.448458    2572 generic.go:356] "Generic (PLEG): container finished" podID="fd176afb-c262-454f-88b9-b86820ec5eeb" containerID="38a229c6ee79212c79805bb2a2b0f94d1c3f95d0ba5d2fb439ca81b3564014f8" exitCode=0
Sep 11 13:04:09.448665 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.448536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn" event={"ID":"fd176afb-c262-454f-88b9-b86820ec5eeb","Type":"ContainerDied","Data":"38a229c6ee79212c79805bb2a2b0f94d1c3f95d0ba5d2fb439ca81b3564014f8"}
Sep 11 13:04:09.460380 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:09.460353    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:04:10.591812 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:10.591792    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"
Sep 11 13:04:10.675915 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:10.675883    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd176afb-c262-454f-88b9-b86820ec5eeb-maas-api-service-ca\") pod \"fd176afb-c262-454f-88b9-b86820ec5eeb\" (UID: \"fd176afb-c262-454f-88b9-b86820ec5eeb\") "
Sep 11 13:04:10.676277 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:10.676253    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd176afb-c262-454f-88b9-b86820ec5eeb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd176afb-c262-454f-88b9-b86820ec5eeb" (UID: "fd176afb-c262-454f-88b9-b86820ec5eeb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:10.777527 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:10.777428    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd176afb-c262-454f-88b9-b86820ec5eeb-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:11.459699 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:11.459668    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"
Sep 11 13:04:11.459882 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:11.459700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn" event={"ID":"fd176afb-c262-454f-88b9-b86820ec5eeb","Type":"ContainerDied","Data":"89e069820550691be4ec9698c9565305c31f234c845715fe79ae248e82fb054f"}
Sep 11 13:04:11.459882 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:11.459751    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89e069820550691be4ec9698c9565305c31f234c845715fe79ae248e82fb054f"
Sep 11 13:04:14.172782 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:14.172742    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"]
Sep 11 13:04:14.175737 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:14.175712    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-6a731442-p88gn"]
Sep 11 13:04:14.313702 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:14.313668    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"]
Sep 11 13:04:14.313978 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:14.313882    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy" containerID="cri-o://ebbeebb918ec195d551e34b2ae07a2dba7e209e8108188041122ef47c79e5b6a" gracePeriod=30
Sep 11 13:04:15.092738 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.092709    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"]
Sep 11 13:04:15.093093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.093082    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd176afb-c262-454f-88b9-b86820ec5eeb" containerName="revoke-keys"
Sep 11 13:04:15.093147 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.093095    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd176afb-c262-454f-88b9-b86820ec5eeb" containerName="revoke-keys"
Sep 11 13:04:15.093183 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.093162    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd176afb-c262-454f-88b9-b86820ec5eeb" containerName="revoke-keys"
Sep 11 13:04:15.095341 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.095306    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.097491 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.097468    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b19d54a4-openshift-default-dockercfg-trk62\""
Sep 11 13:04:15.111554 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.111526    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"]
Sep 11 13:04:15.226233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226093    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-data\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226157    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-socket\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-token\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226291    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istiod-ca-cert\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm45c\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-kube-api-access-qm45c\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-envoy\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-podinfo\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-certs\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.226844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.226604    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-credential-socket\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327006 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.326967    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:15.327215 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:15.327407 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327385    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-token\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327474 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istiod-ca-cert\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327519 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327489    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm45c\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-kube-api-access-qm45c\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327651 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-envoy\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-podinfo\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-certs\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-credential-socket\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-data\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.327980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.327871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-socket\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.328134 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.328091    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-certs\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.328203 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.328188    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-credential-socket\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.328254 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.328200    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-socket\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.328305 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.328258    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istiod-ca-cert\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.328723 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.328701    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-data\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.330586 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.330558    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-envoy\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.330877 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.330858    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-podinfo\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.338639 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.338599    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-token\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.338793 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.338771    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm45c\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-kube-api-access-qm45c\") pod \"e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") " pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.340980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.340959    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:15.405833 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.405803    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:15.491390 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.491362    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:15.683894 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.683809    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"]
Sep 11 13:04:15.686110 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:04:15.686078    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0582bc5_4881_4336_aa36_3aa1cf5fd00c.slice/crio-0777e1015a0ed9decac6d0c5765898c40d573f9da32d28a021bc04332adc1661 WatchSource:0}: Error finding container 0777e1015a0ed9decac6d0c5765898c40d573f9da32d28a021bc04332adc1661: Status 404 returned error can't find the container with id 0777e1015a0ed9decac6d0c5765898c40d573f9da32d28a021bc04332adc1661
Sep 11 13:04:15.688254 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.688226    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:15.688310 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.688288    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:15.688372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:15.688334    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:16.139727 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:16.139699    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd176afb-c262-454f-88b9-b86820ec5eeb" path="/var/lib/kubelet/pods/fd176afb-c262-454f-88b9-b86820ec5eeb/volumes"
Sep 11 13:04:16.485306 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:16.485268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" event={"ID":"f0582bc5-4881-4336-aa36-3aa1cf5fd00c","Type":"ContainerStarted","Data":"f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f"}
Sep 11 13:04:16.485805 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:16.485350    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" event={"ID":"f0582bc5-4881-4336-aa36-3aa1cf5fd00c","Type":"ContainerStarted","Data":"0777e1015a0ed9decac6d0c5765898c40d573f9da32d28a021bc04332adc1661"}
Sep 11 13:04:16.505644 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:16.505591    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" podStartSLOduration=1.505573718 podStartE2EDuration="1.505573718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:16.503756785 +0000 UTC m=+1020.883282720" watchObservedRunningTime="2026-09-11 13:04:16.505573718 +0000 UTC m=+1020.885099716"
Sep 11 13:04:17.406344 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:17.406298    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:17.411483 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:17.411458    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:17.491296 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:17.491262    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:17.492378 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:17.492351    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:19.508863 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.508619    2572 generic.go:356] "Generic (PLEG): container finished" podID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerID="ebbeebb918ec195d551e34b2ae07a2dba7e209e8108188041122ef47c79e5b6a" exitCode=0
Sep 11 13:04:19.508863 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.508660    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" event={"ID":"3cf68ee3-dd4e-4d7a-83da-de03876a5d34","Type":"ContainerDied","Data":"ebbeebb918ec195d551e34b2ae07a2dba7e209e8108188041122ef47c79e5b6a"}
Sep 11 13:04:19.508863 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.508720    2572 scope.go:117] "RemoveContainer" containerID="3ee946130723315ddd3f702ab10e402efe9f99253beb82947cd5c28d2f2469c1"
Sep 11 13:04:19.564653 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.564631    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:04:19.672114 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672086    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-token\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672142    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6l8v\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-kube-api-access-l6l8v\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672172    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-credential-socket\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672205    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-envoy\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672233    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istiod-ca-cert\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672284    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-data\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-socket\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672664 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672368    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-podinfo\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672664 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672456    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-certs\") pod \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\" (UID: \"3cf68ee3-dd4e-4d7a-83da-de03876a5d34\") "
Sep 11 13:04:19.672664 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672531    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:19.672664 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672559    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:19.672664 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672654    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:19.672913 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672696    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:19.672913 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.672823    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:19.673238 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.673198    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.673238 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.673228    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.673462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.673244    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.673462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.673257    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.673462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.673271    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.674707 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.674682    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:19.674707 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.674686    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:19.674839 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.674713    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:04:19.674978 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.674957    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-kube-api-access-l6l8v" (OuterVolumeSpecName: "kube-api-access-l6l8v") pod "3cf68ee3-dd4e-4d7a-83da-de03876a5d34" (UID: "3cf68ee3-dd4e-4d7a-83da-de03876a5d34"). InnerVolumeSpecName "kube-api-access-l6l8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:19.773835 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.773803    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.773835 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.773830    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6l8v\" (UniqueName: \"kubernetes.io/projected/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-kube-api-access-l6l8v\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.773835 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.773840    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.774062 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.773848    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf68ee3-dd4e-4d7a-83da-de03876a5d34-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:19.893362 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.893308    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"]
Sep 11 13:04:19.893693 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.893682    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy"
Sep 11 13:04:19.893765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.893695    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy"
Sep 11 13:04:19.893765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.893703    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy"
Sep 11 13:04:19.893765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.893708    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy"
Sep 11 13:04:19.893861 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.893771    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy"
Sep 11 13:04:19.895753 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.895733    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:19.898136 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.898117    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b19d54a4\""
Sep 11 13:04:19.898238 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.898180    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b19d54a4-dockercfg-v6qqq\""
Sep 11 13:04:19.909607 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:19.909582    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"]
Sep 11 13:04:20.077508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.077409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpngq\" (UniqueName: \"kubernetes.io/projected/70d158c9-dc00-4ec2-9933-0840b3720896-kube-api-access-cpngq\") pod \"payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:20.077508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.077451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70d158c9-dc00-4ec2-9933-0840b3720896-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:20.178460 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.178426    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpngq\" (UniqueName: \"kubernetes.io/projected/70d158c9-dc00-4ec2-9933-0840b3720896-kube-api-access-cpngq\") pod \"payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:20.178623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.178468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70d158c9-dc00-4ec2-9933-0840b3720896-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:20.179197 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.179179    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70d158c9-dc00-4ec2-9933-0840b3720896-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:20.186875 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.186853    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpngq\" (UniqueName: \"kubernetes.io/projected/70d158c9-dc00-4ec2-9933-0840b3720896-kube-api-access-cpngq\") pod \"payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:20.207404 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.207376    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:20.481452 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.481421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"]
Sep 11 13:04:20.483041 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:04:20.483015    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d158c9_dc00_4ec2_9933_0840b3720896.slice/crio-7b6f0a24e8a3f6d91d6e702c31828ca9371e8fd2f81f6def6259c45ec08ce7a4 WatchSource:0}: Error finding container 7b6f0a24e8a3f6d91d6e702c31828ca9371e8fd2f81f6def6259c45ec08ce7a4: Status 404 returned error can't find the container with id 7b6f0a24e8a3f6d91d6e702c31828ca9371e8fd2f81f6def6259c45ec08ce7a4
Sep 11 13:04:20.517073 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.517043    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb" event={"ID":"70d158c9-dc00-4ec2-9933-0840b3720896","Type":"ContainerStarted","Data":"7b6f0a24e8a3f6d91d6e702c31828ca9371e8fd2f81f6def6259c45ec08ce7a4"}
Sep 11 13:04:20.524790 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.524762    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns" event={"ID":"3cf68ee3-dd4e-4d7a-83da-de03876a5d34","Type":"ContainerDied","Data":"b39b09c43514de7f6dea0dc28c6c93bf9bb8573d46ec2e737bf44de650d10017"}
Sep 11 13:04:20.524915 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.524814    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"
Sep 11 13:04:20.524915 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.524842    2572 scope.go:117] "RemoveContainer" containerID="ebbeebb918ec195d551e34b2ae07a2dba7e209e8108188041122ef47c79e5b6a"
Sep 11 13:04:20.546542 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.546508    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"]
Sep 11 13:04:20.553308 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:20.553285    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6a731442-gw-openshift-default-585ccf6fd8-fscns"]
Sep 11 13:04:21.531962 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:21.531927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb" event={"ID":"70d158c9-dc00-4ec2-9933-0840b3720896","Type":"ContainerStarted","Data":"4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581"}
Sep 11 13:04:21.532418 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:21.532124    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:21.549813 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:21.549752    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb" podStartSLOduration=2.54973655 podStartE2EDuration="2.54973655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:21.547495665 +0000 UTC m=+1025.927021600" watchObservedRunningTime="2026-09-11 13:04:21.54973655 +0000 UTC m=+1025.929262485"
Sep 11 13:04:22.139525 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:22.139494    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" path="/var/lib/kubelet/pods/3cf68ee3-dd4e-4d7a-83da-de03876a5d34/volumes"
Sep 11 13:04:32.020811 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.020767    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"]
Sep 11 13:04:32.021857 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.021830    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf68ee3-dd4e-4d7a-83da-de03876a5d34" containerName="istio-proxy"
Sep 11 13:04:32.025457 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.025422    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"
Sep 11 13:04:32.028845 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.028819    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:04:32.028978 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.028818    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:04:32.031723 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.031695    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"]
Sep 11 13:04:32.084205 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.084172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d20841c-e3ce-4551-8e3e-42565f0c683a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r\" (UID: \"8d20841c-e3ce-4551-8e3e-42565f0c683a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"
Sep 11 13:04:32.185814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.185775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d20841c-e3ce-4551-8e3e-42565f0c683a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r\" (UID: \"8d20841c-e3ce-4551-8e3e-42565f0c683a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"
Sep 11 13:04:32.189698 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.186901    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d20841c-e3ce-4551-8e3e-42565f0c683a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r\" (UID: \"8d20841c-e3ce-4551-8e3e-42565f0c683a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"
Sep 11 13:04:32.338279 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.338186    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"
Sep 11 13:04:32.538433 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.538403    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:32.609362 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:32.609253    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"]
Sep 11 13:04:32.614246 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:04:32.614210    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d20841c_e3ce_4551_8e3e_42565f0c683a.slice/crio-0b002ad999a7f77e737cd51bf63fe089eb80b1effff38b8569176cdf60383479 WatchSource:0}: Error finding container 0b002ad999a7f77e737cd51bf63fe089eb80b1effff38b8569176cdf60383479: Status 404 returned error can't find the container with id 0b002ad999a7f77e737cd51bf63fe089eb80b1effff38b8569176cdf60383479
Sep 11 13:04:33.593998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:33.593906    2572 generic.go:356] "Generic (PLEG): container finished" podID="8d20841c-e3ce-4551-8e3e-42565f0c683a" containerID="a7e27104b8810ac66bfd41981c8e3ecf8f9eead3d2d1a5f2f338fb87bd0cb18e" exitCode=0
Sep 11 13:04:33.593998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:33.593957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r" event={"ID":"8d20841c-e3ce-4551-8e3e-42565f0c683a","Type":"ContainerDied","Data":"a7e27104b8810ac66bfd41981c8e3ecf8f9eead3d2d1a5f2f338fb87bd0cb18e"}
Sep 11 13:04:33.594416 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:33.594008    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r" event={"ID":"8d20841c-e3ce-4551-8e3e-42565f0c683a","Type":"ContainerStarted","Data":"0b002ad999a7f77e737cd51bf63fe089eb80b1effff38b8569176cdf60383479"}
Sep 11 13:04:34.734366 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:34.734338    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"
Sep 11 13:04:34.813807 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:34.813776    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d20841c-e3ce-4551-8e3e-42565f0c683a-maas-api-service-ca\") pod \"8d20841c-e3ce-4551-8e3e-42565f0c683a\" (UID: \"8d20841c-e3ce-4551-8e3e-42565f0c683a\") "
Sep 11 13:04:34.814140 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:34.814111    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d20841c-e3ce-4551-8e3e-42565f0c683a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d20841c-e3ce-4551-8e3e-42565f0c683a" (UID: "8d20841c-e3ce-4551-8e3e-42565f0c683a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:34.915417 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:34.915390    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d20841c-e3ce-4551-8e3e-42565f0c683a-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:35.053698 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:35.053663    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"]
Sep 11 13:04:35.606886 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:35.606861    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"
Sep 11 13:04:35.607085 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:35.606901    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r" event={"ID":"8d20841c-e3ce-4551-8e3e-42565f0c683a","Type":"ContainerDied","Data":"0b002ad999a7f77e737cd51bf63fe089eb80b1effff38b8569176cdf60383479"}
Sep 11 13:04:35.607085 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:35.606958    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b002ad999a7f77e737cd51bf63fe089eb80b1effff38b8569176cdf60383479"
Sep 11 13:04:37.210639 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:37.210598    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"]
Sep 11 13:04:42.580653 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:42.580612    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"]
Sep 11 13:04:42.583570 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:42.583541    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5f1b61-7cb4r"]
Sep 11 13:04:43.721839 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.721800    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"]
Sep 11 13:04:43.722515 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.722494    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d20841c-e3ce-4551-8e3e-42565f0c683a" containerName="revoke-keys"
Sep 11 13:04:43.722600 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.722520    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d20841c-e3ce-4551-8e3e-42565f0c683a" containerName="revoke-keys"
Sep 11 13:04:43.722639 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.722625    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d20841c-e3ce-4551-8e3e-42565f0c683a" containerName="revoke-keys"
Sep 11 13:04:43.725402 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.725385    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"
Sep 11 13:04:43.727573 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.727551    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:04:43.727727 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.727709    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:04:43.731990 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.731942    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"]
Sep 11 13:04:43.818401 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.818347    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7c911d-25ed-4cac-845b-9a77126f2b28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5\" (UID: \"8a7c911d-25ed-4cac-845b-9a77126f2b28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"
Sep 11 13:04:43.920027 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.919989    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7c911d-25ed-4cac-845b-9a77126f2b28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5\" (UID: \"8a7c911d-25ed-4cac-845b-9a77126f2b28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"
Sep 11 13:04:43.920754 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:43.920733    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7c911d-25ed-4cac-845b-9a77126f2b28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5\" (UID: \"8a7c911d-25ed-4cac-845b-9a77126f2b28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"
Sep 11 13:04:44.039186 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:44.039095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"
Sep 11 13:04:44.140902 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:44.140866    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d20841c-e3ce-4551-8e3e-42565f0c683a" path="/var/lib/kubelet/pods/8d20841c-e3ce-4551-8e3e-42565f0c683a/volumes"
Sep 11 13:04:44.311232 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:44.311146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"]
Sep 11 13:04:44.314807 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:04:44.314771    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7c911d_25ed_4cac_845b_9a77126f2b28.slice/crio-4d06c1cd4db4c7407bd76938e69c856ebfea031a93464880457fface388ef4d5 WatchSource:0}: Error finding container 4d06c1cd4db4c7407bd76938e69c856ebfea031a93464880457fface388ef4d5: Status 404 returned error can't find the container with id 4d06c1cd4db4c7407bd76938e69c856ebfea031a93464880457fface388ef4d5
Sep 11 13:04:44.660467 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:44.660427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5" event={"ID":"8a7c911d-25ed-4cac-845b-9a77126f2b28","Type":"ContainerStarted","Data":"98bf3c0930db95357a6a5348f1bd4876b369536ca866074de8df0969cdb2f7d0"}
Sep 11 13:04:44.660643 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:44.660489    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5" event={"ID":"8a7c911d-25ed-4cac-845b-9a77126f2b28","Type":"ContainerStarted","Data":"4d06c1cd4db4c7407bd76938e69c856ebfea031a93464880457fface388ef4d5"}
Sep 11 13:04:44.677085 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:44.677031    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5" podStartSLOduration=1.6770146179999998 podStartE2EDuration="1.677014618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:44.675492021 +0000 UTC m=+1049.055017958" watchObservedRunningTime="2026-09-11 13:04:44.677014618 +0000 UTC m=+1049.056540553"
Sep 11 13:04:45.667302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:45.667269    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a7c911d-25ed-4cac-845b-9a77126f2b28" containerID="98bf3c0930db95357a6a5348f1bd4876b369536ca866074de8df0969cdb2f7d0" exitCode=0
Sep 11 13:04:45.667760 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:45.667346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5" event={"ID":"8a7c911d-25ed-4cac-845b-9a77126f2b28","Type":"ContainerDied","Data":"98bf3c0930db95357a6a5348f1bd4876b369536ca866074de8df0969cdb2f7d0"}
Sep 11 13:04:46.674421 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.674389    2572 generic.go:356] "Generic (PLEG): container finished" podID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerID="f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f" exitCode=0
Sep 11 13:04:46.674889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.674462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" event={"ID":"f0582bc5-4881-4336-aa36-3aa1cf5fd00c","Type":"ContainerDied","Data":"f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f"}
Sep 11 13:04:46.675188 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.674934    2572 scope.go:117] "RemoveContainer" containerID="f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f"
Sep 11 13:04:46.675990 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.675961    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:46.676098 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.676033    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:46.676098 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.676062    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:46.812633 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.812609    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"
Sep 11 13:04:46.953272 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.953182    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7c911d-25ed-4cac-845b-9a77126f2b28-maas-api-service-ca\") pod \"8a7c911d-25ed-4cac-845b-9a77126f2b28\" (UID: \"8a7c911d-25ed-4cac-845b-9a77126f2b28\") "
Sep 11 13:04:46.953547 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.953525    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a7c911d-25ed-4cac-845b-9a77126f2b28-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a7c911d-25ed-4cac-845b-9a77126f2b28" (UID: "8a7c911d-25ed-4cac-845b-9a77126f2b28"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:46.953666 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:46.953648    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7c911d-25ed-4cac-845b-9a77126f2b28-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:47.492024 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:47.491932    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:47.683928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:47.683881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5" event={"ID":"8a7c911d-25ed-4cac-845b-9a77126f2b28","Type":"ContainerDied","Data":"4d06c1cd4db4c7407bd76938e69c856ebfea031a93464880457fface388ef4d5"}
Sep 11 13:04:47.684437 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:47.683989    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d06c1cd4db4c7407bd76938e69c856ebfea031a93464880457fface388ef4d5"
Sep 11 13:04:47.684437 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:47.684063    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"
Sep 11 13:04:47.691497 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:47.691453    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" event={"ID":"f0582bc5-4881-4336-aa36-3aa1cf5fd00c","Type":"ContainerStarted","Data":"b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b"}
Sep 11 13:04:48.406581 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:48.406526    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:48.407614 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:48.407583    2572 patch_prober.go:28] interesting pod/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 11 13:04:48.407748 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:48.407648    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 11 13:04:49.406787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:49.406741    2572 patch_prober.go:28] interesting pod/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 11 13:04:49.407274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:49.406809    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 11 13:04:50.073100 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.073054    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d" podUID="5c338088-4034-40bd-a9d1-abb28d254e72" containerName="main" containerID="cri-o://f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933" gracePeriod=45
Sep 11 13:04:50.133233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.133169    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"]
Sep 11 13:04:50.133610 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.133521    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb" podUID="70d158c9-dc00-4ec2-9933-0840b3720896" containerName="payload-pre-processing" containerID="cri-o://4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581" gracePeriod=30
Sep 11 13:04:50.318447 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.317471    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"]
Sep 11 13:04:50.319821 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.319722    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b19d54a4-lzzn5"]
Sep 11 13:04:50.417344 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.409771    2572 patch_prober.go:28] interesting pod/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 11 13:04:50.417344 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.409848    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 11 13:04:50.481543 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.481519    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:04:50.504569 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.504483    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:50.612377 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612271    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8lt2\" (UniqueName: \"kubernetes.io/projected/5c338088-4034-40bd-a9d1-abb28d254e72-kube-api-access-p8lt2\") pod \"5c338088-4034-40bd-a9d1-abb28d254e72\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") "
Sep 11 13:04:50.612377 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612346    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-home\") pod \"5c338088-4034-40bd-a9d1-abb28d254e72\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") "
Sep 11 13:04:50.612608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612385    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-dshm\") pod \"5c338088-4034-40bd-a9d1-abb28d254e72\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") "
Sep 11 13:04:50.612608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612425    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-model-cache\") pod \"5c338088-4034-40bd-a9d1-abb28d254e72\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") "
Sep 11 13:04:50.612608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612471    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c338088-4034-40bd-a9d1-abb28d254e72-tls-certs\") pod \"5c338088-4034-40bd-a9d1-abb28d254e72\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") "
Sep 11 13:04:50.612608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612495    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70d158c9-dc00-4ec2-9933-0840b3720896-plugins-config-volume\") pod \"70d158c9-dc00-4ec2-9933-0840b3720896\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") "
Sep 11 13:04:50.612608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612536    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpngq\" (UniqueName: \"kubernetes.io/projected/70d158c9-dc00-4ec2-9933-0840b3720896-kube-api-access-cpngq\") pod \"70d158c9-dc00-4ec2-9933-0840b3720896\" (UID: \"70d158c9-dc00-4ec2-9933-0840b3720896\") "
Sep 11 13:04:50.612608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612576    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-tmp-dir\") pod \"5c338088-4034-40bd-a9d1-abb28d254e72\" (UID: \"5c338088-4034-40bd-a9d1-abb28d254e72\") "
Sep 11 13:04:50.612928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612614    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-home" (OuterVolumeSpecName: "home") pod "5c338088-4034-40bd-a9d1-abb28d254e72" (UID: "5c338088-4034-40bd-a9d1-abb28d254e72"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:50.612928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612686    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c338088-4034-40bd-a9d1-abb28d254e72" (UID: "5c338088-4034-40bd-a9d1-abb28d254e72"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:50.612928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612868    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c338088-4034-40bd-a9d1-abb28d254e72" (UID: "5c338088-4034-40bd-a9d1-abb28d254e72"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:50.613066 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612929    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d158c9-dc00-4ec2-9933-0840b3720896-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "70d158c9-dc00-4ec2-9933-0840b3720896" (UID: "70d158c9-dc00-4ec2-9933-0840b3720896"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:50.613066 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612952    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-model-cache\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.613066 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612968    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-tmp-dir\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.613066 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.612980    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-home\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.614884 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.614855    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-dshm" (OuterVolumeSpecName: "dshm") pod "5c338088-4034-40bd-a9d1-abb28d254e72" (UID: "5c338088-4034-40bd-a9d1-abb28d254e72"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:50.615009 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.614896    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c338088-4034-40bd-a9d1-abb28d254e72-kube-api-access-p8lt2" (OuterVolumeSpecName: "kube-api-access-p8lt2") pod "5c338088-4034-40bd-a9d1-abb28d254e72" (UID: "5c338088-4034-40bd-a9d1-abb28d254e72"). InnerVolumeSpecName "kube-api-access-p8lt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:50.615009 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.614919    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c338088-4034-40bd-a9d1-abb28d254e72-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c338088-4034-40bd-a9d1-abb28d254e72" (UID: "5c338088-4034-40bd-a9d1-abb28d254e72"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:50.615009 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.614966    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d158c9-dc00-4ec2-9933-0840b3720896-kube-api-access-cpngq" (OuterVolumeSpecName: "kube-api-access-cpngq") pod "70d158c9-dc00-4ec2-9933-0840b3720896" (UID: "70d158c9-dc00-4ec2-9933-0840b3720896"). InnerVolumeSpecName "kube-api-access-cpngq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:50.713696 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.713661    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8lt2\" (UniqueName: \"kubernetes.io/projected/5c338088-4034-40bd-a9d1-abb28d254e72-kube-api-access-p8lt2\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.713696 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.713696    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c338088-4034-40bd-a9d1-abb28d254e72-dshm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.713696 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.713710    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c338088-4034-40bd-a9d1-abb28d254e72-tls-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.713949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.713725    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70d158c9-dc00-4ec2-9933-0840b3720896-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.713949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.713738    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpngq\" (UniqueName: \"kubernetes.io/projected/70d158c9-dc00-4ec2-9933-0840b3720896-kube-api-access-cpngq\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:50.714364 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.714339    2572 generic.go:356] "Generic (PLEG): container finished" podID="70d158c9-dc00-4ec2-9933-0840b3720896" containerID="4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581" exitCode=0
Sep 11 13:04:50.714464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.714387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb" event={"ID":"70d158c9-dc00-4ec2-9933-0840b3720896","Type":"ContainerDied","Data":"4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581"}
Sep 11 13:04:50.714464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.714421    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"
Sep 11 13:04:50.714464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.714444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb" event={"ID":"70d158c9-dc00-4ec2-9933-0840b3720896","Type":"ContainerDied","Data":"7b6f0a24e8a3f6d91d6e702c31828ca9371e8fd2f81f6def6259c45ec08ce7a4"}
Sep 11 13:04:50.714464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.714465    2572 scope.go:117] "RemoveContainer" containerID="4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581"
Sep 11 13:04:50.715863 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.715842    2572 generic.go:356] "Generic (PLEG): container finished" podID="5c338088-4034-40bd-a9d1-abb28d254e72" containerID="f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933" exitCode=0
Sep 11 13:04:50.715957 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.715919    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d" event={"ID":"5c338088-4034-40bd-a9d1-abb28d254e72","Type":"ContainerDied","Data":"f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933"}
Sep 11 13:04:50.716168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.716142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d" event={"ID":"5c338088-4034-40bd-a9d1-abb28d254e72","Type":"ContainerDied","Data":"8ecde288fa33449bacd0a0f7bc34a2946ed0dbd908c06522484a8f99f5d46261"}
Sep 11 13:04:50.716427 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.716400    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"
Sep 11 13:04:50.726058 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.726034    2572 scope.go:117] "RemoveContainer" containerID="4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581"
Sep 11 13:04:50.726750 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:04:50.726725    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581\": container with ID starting with 4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581 not found: ID does not exist" containerID="4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581"
Sep 11 13:04:50.726855 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.726781    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581"} err="failed to get container status \"4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581\": rpc error: code = NotFound desc = could not find container \"4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581\": container with ID starting with 4e62aa7e7116d5d099c94cd93732e02485455fcc679fa1e48944809cb6858581 not found: ID does not exist"
Sep 11 13:04:50.726855 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.726805    2572 scope.go:117] "RemoveContainer" containerID="f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933"
Sep 11 13:04:50.735682 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.735666    2572 scope.go:117] "RemoveContainer" containerID="f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933"
Sep 11 13:04:50.735911 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:04:50.735890    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933\": container with ID starting with f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933 not found: ID does not exist" containerID="f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933"
Sep 11 13:04:50.735973 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.735921    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933"} err="failed to get container status \"f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933\": rpc error: code = NotFound desc = could not find container \"f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933\": container with ID starting with f3c2439a173d058be7b933e4f95b40e443770da5ceec9adef217bcb6228b0933 not found: ID does not exist"
Sep 11 13:04:50.744129 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.744105    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"]
Sep 11 13:04:50.747944 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.747924    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b19d54a4-86c4d9449d-q8tcb"]
Sep 11 13:04:50.757756 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.757726    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"]
Sep 11 13:04:50.762293 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:50.762271    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-5f1b61/autores-model-5f1b61-kserve-7b96fd494c-k7z9d"]
Sep 11 13:04:51.406805 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:51.406767    2572 patch_prober.go:28] interesting pod/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 11 13:04:51.407018 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:51.406849    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 11 13:04:51.520384 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:51.520348    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"]
Sep 11 13:04:51.521152 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:51.521121    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy" containerID="cri-o://b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b" gracePeriod=30
Sep 11 13:04:52.140534 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.140498    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c338088-4034-40bd-a9d1-abb28d254e72" path="/var/lib/kubelet/pods/5c338088-4034-40bd-a9d1-abb28d254e72/volumes"
Sep 11 13:04:52.140893 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.140878    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d158c9-dc00-4ec2-9933-0840b3720896" path="/var/lib/kubelet/pods/70d158c9-dc00-4ec2-9933-0840b3720896/volumes"
Sep 11 13:04:52.141173 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.141161    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7c911d-25ed-4cac-845b-9a77126f2b28" path="/var/lib/kubelet/pods/8a7c911d-25ed-4cac-845b-9a77126f2b28/volumes"
Sep 11 13:04:52.230032 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.229995    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc" podUID="c4929dba-45cd-43e6-8945-2dd227637326" containerName="main" containerID="cri-o://a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573" gracePeriod=45
Sep 11 13:04:52.391409 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.386110    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"]
Sep 11 13:04:52.392217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.392191    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a7c911d-25ed-4cac-845b-9a77126f2b28" containerName="revoke-keys"
Sep 11 13:04:52.392389 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.392377    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7c911d-25ed-4cac-845b-9a77126f2b28" containerName="revoke-keys"
Sep 11 13:04:52.392512 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.392501    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d158c9-dc00-4ec2-9933-0840b3720896" containerName="payload-pre-processing"
Sep 11 13:04:52.392600 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.392591    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d158c9-dc00-4ec2-9933-0840b3720896" containerName="payload-pre-processing"
Sep 11 13:04:52.392714 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.392704    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c338088-4034-40bd-a9d1-abb28d254e72" containerName="main"
Sep 11 13:04:52.392790 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.392781    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c338088-4034-40bd-a9d1-abb28d254e72" containerName="main"
Sep 11 13:04:52.392961 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.392949    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c338088-4034-40bd-a9d1-abb28d254e72" containerName="main"
Sep 11 13:04:52.393060 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.393049    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d158c9-dc00-4ec2-9933-0840b3720896" containerName="payload-pre-processing"
Sep 11 13:04:52.393143 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.393133    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a7c911d-25ed-4cac-845b-9a77126f2b28" containerName="revoke-keys"
Sep 11 13:04:52.414877 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.414854    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.421733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.421665    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-25a0b392-openshift-default-dockercfg-fgh8t\""
Sep 11 13:04:52.435713 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.435681    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"]
Sep 11 13:04:52.516031 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.516004    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:52.532014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.531616    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-envoy\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.531691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-certs\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.531727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-istio-token\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.531842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc98155-bb45-4211-b328-1b461be58ac0-istio-podinfo\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.531922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-socket\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.531959    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc98155-bb45-4211-b328-1b461be58ac0-istiod-ca-cert\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.532003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-data\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532699 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.532105    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-credential-socket\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.532699 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.532135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85lls\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-kube-api-access-85lls\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.633053 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633023    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nnm8\" (UniqueName: \"kubernetes.io/projected/c4929dba-45cd-43e6-8945-2dd227637326-kube-api-access-9nnm8\") pod \"c4929dba-45cd-43e6-8945-2dd227637326\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") "
Sep 11 13:04:52.633265 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633085    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-home\") pod \"c4929dba-45cd-43e6-8945-2dd227637326\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") "
Sep 11 13:04:52.633265 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633109    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-tmp-dir\") pod \"c4929dba-45cd-43e6-8945-2dd227637326\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") "
Sep 11 13:04:52.633265 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633168    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-model-cache\") pod \"c4929dba-45cd-43e6-8945-2dd227637326\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") "
Sep 11 13:04:52.633265 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633227    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4929dba-45cd-43e6-8945-2dd227637326-tls-certs\") pod \"c4929dba-45cd-43e6-8945-2dd227637326\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") "
Sep 11 13:04:52.633265 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633265    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-dshm\") pod \"c4929dba-45cd-43e6-8945-2dd227637326\" (UID: \"c4929dba-45cd-43e6-8945-2dd227637326\") "
Sep 11 13:04:52.633540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633435    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4929dba-45cd-43e6-8945-2dd227637326" (UID: "c4929dba-45cd-43e6-8945-2dd227637326"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:52.633540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633451    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4929dba-45cd-43e6-8945-2dd227637326" (UID: "c4929dba-45cd-43e6-8945-2dd227637326"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:52.633540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633450    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-envoy\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.633540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-home" (OuterVolumeSpecName: "home") pod "c4929dba-45cd-43e6-8945-2dd227637326" (UID: "c4929dba-45cd-43e6-8945-2dd227637326"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:52.633540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633517    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-certs\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.633810 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-istio-token\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.633810 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc98155-bb45-4211-b328-1b461be58ac0-istio-podinfo\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.633924 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-socket\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.633924 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc98155-bb45-4211-b328-1b461be58ac0-istiod-ca-cert\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.633924 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-data\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.634074 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.633981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-credential-socket\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.634074 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85lls\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-kube-api-access-85lls\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.634074 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-certs\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.634219 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634183    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-model-cache\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:52.634219 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634212    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-home\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:52.634337 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634229    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-tmp-dir\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:52.634337 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-socket\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.634610 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634585    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-data\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.634741 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.634651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-credential-socket\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.635311 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.635285    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc98155-bb45-4211-b328-1b461be58ac0-istiod-ca-cert\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.635925 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.635900    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4929dba-45cd-43e6-8945-2dd227637326-kube-api-access-9nnm8" (OuterVolumeSpecName: "kube-api-access-9nnm8") pod "c4929dba-45cd-43e6-8945-2dd227637326" (UID: "c4929dba-45cd-43e6-8945-2dd227637326"). InnerVolumeSpecName "kube-api-access-9nnm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:52.636192 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.636174    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-dshm" (OuterVolumeSpecName: "dshm") pod "c4929dba-45cd-43e6-8945-2dd227637326" (UID: "c4929dba-45cd-43e6-8945-2dd227637326"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:52.636866 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.636841    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4929dba-45cd-43e6-8945-2dd227637326-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4929dba-45cd-43e6-8945-2dd227637326" (UID: "c4929dba-45cd-43e6-8945-2dd227637326"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:04:52.637010 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.636991    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-envoy\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.637480 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.637462    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc98155-bb45-4211-b328-1b461be58ac0-istio-podinfo\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.643976 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.643835    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85lls\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-kube-api-access-85lls\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.644036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.643982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-istio-token\") pod \"e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") " pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.727088 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.727053    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:52.731372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.731309    2572 generic.go:356] "Generic (PLEG): container finished" podID="c4929dba-45cd-43e6-8945-2dd227637326" containerID="a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573" exitCode=0
Sep 11 13:04:52.731372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.731360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc" event={"ID":"c4929dba-45cd-43e6-8945-2dd227637326","Type":"ContainerDied","Data":"a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573"}
Sep 11 13:04:52.731569 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.731413    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc" event={"ID":"c4929dba-45cd-43e6-8945-2dd227637326","Type":"ContainerDied","Data":"6131dd77800e897b84aa45be16da0cf32ed5a3e208f5786c9d4e0ac1f0c6d7c0"}
Sep 11 13:04:52.731569 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.731432    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"
Sep 11 13:04:52.731569 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.731436    2572 scope.go:117] "RemoveContainer" containerID="a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573"
Sep 11 13:04:52.735150 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.735126    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4929dba-45cd-43e6-8945-2dd227637326-tls-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:52.735258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.735154    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4929dba-45cd-43e6-8945-2dd227637326-dshm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:52.735258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.735170    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nnm8\" (UniqueName: \"kubernetes.io/projected/c4929dba-45cd-43e6-8945-2dd227637326-kube-api-access-9nnm8\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:52.742283 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.742261    2572 scope.go:117] "RemoveContainer" containerID="a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573"
Sep 11 13:04:52.742862 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:04:52.742821    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573\": container with ID starting with a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573 not found: ID does not exist" containerID="a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573"
Sep 11 13:04:52.742977 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.742868    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573"} err="failed to get container status \"a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573\": rpc error: code = NotFound desc = could not find container \"a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573\": container with ID starting with a7aa91bf7a03cc599c5c8d6681305a5317325b7bd02ccdfe4e81d99286904573 not found: ID does not exist"
Sep 11 13:04:52.760580 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.760549    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"]
Sep 11 13:04:52.766311 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:52.766275    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-b18cb0e6-kserve-8485b7cf6d-nt9tc"]
Sep 11 13:04:53.035529 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:53.035504    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"]
Sep 11 13:04:53.037824 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:04:53.037797    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc98155_bb45_4211_b328_1b461be58ac0.slice/crio-8778b21dd4e792a6131a45fce8aa6424d202c526d59d88533aea81a9fe3d0931 WatchSource:0}: Error finding container 8778b21dd4e792a6131a45fce8aa6424d202c526d59d88533aea81a9fe3d0931: Status 404 returned error can't find the container with id 8778b21dd4e792a6131a45fce8aa6424d202c526d59d88533aea81a9fe3d0931
Sep 11 13:04:53.039989 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:53.039957    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:53.040063 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:53.040022    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:53.040063 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:53.040051    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:04:53.739696 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:53.739662    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" event={"ID":"cfc98155-bb45-4211-b328-1b461be58ac0","Type":"ContainerStarted","Data":"85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f"}
Sep 11 13:04:53.740080 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:53.739712    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" event={"ID":"cfc98155-bb45-4211-b328-1b461be58ac0","Type":"ContainerStarted","Data":"8778b21dd4e792a6131a45fce8aa6424d202c526d59d88533aea81a9fe3d0931"}
Sep 11 13:04:53.775258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:53.775209    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" podStartSLOduration=1.7751937359999999 podStartE2EDuration="1.775193736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:53.774124208 +0000 UTC m=+1058.153650146" watchObservedRunningTime="2026-09-11 13:04:53.775193736 +0000 UTC m=+1058.154719672"
Sep 11 13:04:54.140545 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:54.140464    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4929dba-45cd-43e6-8945-2dd227637326" path="/var/lib/kubelet/pods/c4929dba-45cd-43e6-8945-2dd227637326/volumes"
Sep 11 13:04:54.727553 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:54.727514    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:54.732702 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:54.732677    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:54.744731 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:54.744706    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:54.745588 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:54.745571    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:04:55.448375 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:55.448344    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"]
Sep 11 13:04:55.448572 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:55.448544    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy" containerID="cri-o://1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726" gracePeriod=30
Sep 11 13:04:57.983594 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:57.983566    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:58.089902 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.089815    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-data\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.089902 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.089866    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istiod-ca-cert\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.089902 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.089892    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-credential-socket\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.090209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.089915    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-podinfo\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.090209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.089939    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-token\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.090209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090019    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-certs\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.090209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090087    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm45c\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-kube-api-access-qm45c\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.090209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090121    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-socket\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.090209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090150    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-envoy\") pod \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\" (UID: \"f0582bc5-4881-4336-aa36-3aa1cf5fd00c\") "
Sep 11 13:04:58.090584 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090148    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:58.090584 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090171    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:58.090584 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090496    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:58.090758 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090591    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:04:58.091027 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.090998    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:58.093136 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.093088    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:04:58.093297 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.093269    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:58.093297 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.093282    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-kube-api-access-qm45c" (OuterVolumeSpecName: "kube-api-access-qm45c") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "kube-api-access-qm45c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:04:58.093550 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.093534    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f0582bc5-4881-4336-aa36-3aa1cf5fd00c" (UID: "f0582bc5-4881-4336-aa36-3aa1cf5fd00c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:04:58.191880 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191839    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.191880 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191883    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm45c\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-kube-api-access-qm45c\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.192086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191900    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.192086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191915    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.192086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191928    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.192086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191941    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.192086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191953    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.192086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191965    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.192086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.191978    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0582bc5-4881-4336-aa36-3aa1cf5fd00c-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:04:58.768283 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.768252    2572 generic.go:356] "Generic (PLEG): container finished" podID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerID="b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b" exitCode=0
Sep 11 13:04:58.768477 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.768300    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"
Sep 11 13:04:58.768477 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.768347    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" event={"ID":"f0582bc5-4881-4336-aa36-3aa1cf5fd00c","Type":"ContainerDied","Data":"b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b"}
Sep 11 13:04:58.768477 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.768407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls" event={"ID":"f0582bc5-4881-4336-aa36-3aa1cf5fd00c","Type":"ContainerDied","Data":"0777e1015a0ed9decac6d0c5765898c40d573f9da32d28a021bc04332adc1661"}
Sep 11 13:04:58.768477 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.768432    2572 scope.go:117] "RemoveContainer" containerID="b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b"
Sep 11 13:04:58.777602 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.777584    2572 scope.go:117] "RemoveContainer" containerID="f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f"
Sep 11 13:04:58.785604 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.785585    2572 scope.go:117] "RemoveContainer" containerID="b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b"
Sep 11 13:04:58.785888 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:04:58.785870    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b\": container with ID starting with b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b not found: ID does not exist" containerID="b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b"
Sep 11 13:04:58.785950 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.785898    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b"} err="failed to get container status \"b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b\": rpc error: code = NotFound desc = could not find container \"b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b\": container with ID starting with b6cdd70251124a399bbccbedc36ebb654d3e12ca6d3725f1a883dbcd40890e2b not found: ID does not exist"
Sep 11 13:04:58.785950 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.785915    2572 scope.go:117] "RemoveContainer" containerID="f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f"
Sep 11 13:04:58.786180 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:04:58.786164    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f\": container with ID starting with f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f not found: ID does not exist" containerID="f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f"
Sep 11 13:04:58.786228 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.786184    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f"} err="failed to get container status \"f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f\": rpc error: code = NotFound desc = could not find container \"f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f\": container with ID starting with f7c27483570e62c8780dddf98ae7754d2b449554c2c2500ee91b26973a002f5f not found: ID does not exist"
Sep 11 13:04:58.798567 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.798543    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"]
Sep 11 13:04:58.804827 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:04:58.804795    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b19d54a4-openshift-default-566487796d-tf4ls"]
Sep 11 13:05:00.139744 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.139711    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" path="/var/lib/kubelet/pods/f0582bc5-4881-4336-aa36-3aa1cf5fd00c/volumes"
Sep 11 13:05:00.697771 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.697750    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:05:00.783916 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.783827    2572 generic.go:356] "Generic (PLEG): container finished" podID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerID="1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726" exitCode=0
Sep 11 13:05:00.783916 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.783884    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"
Sep 11 13:05:00.783916 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.783889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" event={"ID":"e45bdf99-f778-40ac-9956-b9ad028fef98","Type":"ContainerDied","Data":"1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726"}
Sep 11 13:05:00.784168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.783945    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm" event={"ID":"e45bdf99-f778-40ac-9956-b9ad028fef98","Type":"ContainerDied","Data":"5b4bcd7ed1c6785befe72ba103e3206dce76d71cb3efbaf3cde9a4c6025058eb"}
Sep 11 13:05:00.784168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.783976    2572 scope.go:117] "RemoveContainer" containerID="1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726"
Sep 11 13:05:00.792709 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.792691    2572 scope.go:117] "RemoveContainer" containerID="f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9"
Sep 11 13:05:00.800498 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.800481    2572 scope.go:117] "RemoveContainer" containerID="1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726"
Sep 11 13:05:00.800747 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:05:00.800726    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726\": container with ID starting with 1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726 not found: ID does not exist" containerID="1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726"
Sep 11 13:05:00.800815 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.800759    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726"} err="failed to get container status \"1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726\": rpc error: code = NotFound desc = could not find container \"1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726\": container with ID starting with 1f402dfd8a762f4411d9b327de835f731d7d26ce6e945fb67518927c1881b726 not found: ID does not exist"
Sep 11 13:05:00.800815 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.800786    2572 scope.go:117] "RemoveContainer" containerID="f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9"
Sep 11 13:05:00.801073 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:05:00.801054    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9\": container with ID starting with f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9 not found: ID does not exist" containerID="f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9"
Sep 11 13:05:00.801115 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.801082    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9"} err="failed to get container status \"f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9\": rpc error: code = NotFound desc = could not find container \"f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9\": container with ID starting with f8eada4b92ce2733322c8f2fec9260a7d44c60bfc291203904aab7dd1fa77eb9 not found: ID does not exist"
Sep 11 13:05:00.817484 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817453    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-socket\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817577 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817514    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvl9j\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-kube-api-access-lvl9j\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817577 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817563    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-credential-socket\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817692 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817597    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-data\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817692 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817625    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-token\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817692 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817651    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-envoy\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817701    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:00.817837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817716    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45bdf99-f778-40ac-9956-b9ad028fef98-istiod-ca-cert\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817771    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-certs\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.817837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817835    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-podinfo\") pod \"e45bdf99-f778-40ac-9956-b9ad028fef98\" (UID: \"e45bdf99-f778-40ac-9956-b9ad028fef98\") "
Sep 11 13:05:00.818022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817842    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:00.818022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.817910    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-data" (OuterVolumeSpecName: "istio-data") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:00.818109 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.818064    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:00.818158 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.818137    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e45bdf99-f778-40ac-9956-b9ad028fef98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:05:00.818221 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.818204    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.818271 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.818228    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.818271 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.818242    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.818271 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.818254    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.820058 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.820030    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-kube-api-access-lvl9j" (OuterVolumeSpecName: "kube-api-access-lvl9j") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "kube-api-access-lvl9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:05:00.820151 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.820070    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:00.820337 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.820296    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-token" (OuterVolumeSpecName: "istio-token") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:05:00.820510 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.820493    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e45bdf99-f778-40ac-9956-b9ad028fef98" (UID: "e45bdf99-f778-40ac-9956-b9ad028fef98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:05:00.919058 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.919027    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.919058 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.919060    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.919232 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.919071    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45bdf99-f778-40ac-9956-b9ad028fef98-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.919232 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.919078    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45bdf99-f778-40ac-9956-b9ad028fef98-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:00.919232 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:00.919087    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvl9j\" (UniqueName: \"kubernetes.io/projected/e45bdf99-f778-40ac-9956-b9ad028fef98-kube-api-access-lvl9j\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:01.109831 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:01.109797    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"]
Sep 11 13:05:01.113744 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:01.113721    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-5f1b61-openshift-default-787c74bd9b-dggdm"]
Sep 11 13:05:02.140702 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:02.140669    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" path="/var/lib/kubelet/pods/e45bdf99-f778-40ac-9956-b9ad028fef98/volumes"
Sep 11 13:05:04.659126 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659090    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"]
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659472    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4929dba-45cd-43e6-8945-2dd227637326" containerName="main"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659483    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4929dba-45cd-43e6-8945-2dd227637326" containerName="main"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659498    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659503    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659512    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659518    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659525    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659531    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659537    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy"
Sep 11 13:05:04.659546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659541    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy"
Sep 11 13:05:04.659842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659598    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4929dba-45cd-43e6-8945-2dd227637326" containerName="main"
Sep 11 13:05:04.659842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659606    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy"
Sep 11 13:05:04.659842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659612    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy"
Sep 11 13:05:04.659842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659620    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0582bc5-4881-4336-aa36-3aa1cf5fd00c" containerName="istio-proxy"
Sep 11 13:05:04.659842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.659625    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e45bdf99-f778-40ac-9956-b9ad028fef98" containerName="istio-proxy"
Sep 11 13:05:04.662384 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.662367    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:04.667721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.667697    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-3dec4b\""
Sep 11 13:05:04.668350 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.668309    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-3dec4b-dockercfg-5mz4t\""
Sep 11 13:05:04.678620 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.678593    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"]
Sep 11 13:05:04.747343 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.747277    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"]
Sep 11 13:05:04.749827 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.749794    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:04.749955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.749859    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtzkz\" (UniqueName: \"kubernetes.io/projected/2ad3455e-9efb-468b-97aa-f49fb94af722-kube-api-access-qtzkz\") pod \"payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:04.749955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.749913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ad3455e-9efb-468b-97aa-f49fb94af722-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:04.775629 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.775591    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"]
Sep 11 13:05:04.850287 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.850257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:04.850524 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.850306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtzkz\" (UniqueName: \"kubernetes.io/projected/2ad3455e-9efb-468b-97aa-f49fb94af722-kube-api-access-qtzkz\") pod \"payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:04.850524 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.850400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ad3455e-9efb-468b-97aa-f49fb94af722-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:04.850524 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.850450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kd6\" (UniqueName: \"kubernetes.io/projected/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-kube-api-access-c9kd6\") pod \"payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:04.851086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.851069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ad3455e-9efb-468b-97aa-f49fb94af722-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:04.859655 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.859626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtzkz\" (UniqueName: \"kubernetes.io/projected/2ad3455e-9efb-468b-97aa-f49fb94af722-kube-api-access-qtzkz\") pod \"payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:04.950993 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.950889    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kd6\" (UniqueName: \"kubernetes.io/projected/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-kube-api-access-c9kd6\") pod \"payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:04.950993 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.950965    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:04.951688 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.951669    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:04.960259 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.960233    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kd6\" (UniqueName: \"kubernetes.io/projected/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-kube-api-access-c9kd6\") pod \"payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:04.972123 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:04.972088    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:05.064755 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.064722    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:05.250767 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.250715    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"]
Sep 11 13:05:05.252817 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:05:05.252784    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad3455e_9efb_468b_97aa_f49fb94af722.slice/crio-692db5efd3467c7383b1d1eaee1f561b5406becc45734b64d4eb2a253c108ca0 WatchSource:0}: Error finding container 692db5efd3467c7383b1d1eaee1f561b5406becc45734b64d4eb2a253c108ca0: Status 404 returned error can't find the container with id 692db5efd3467c7383b1d1eaee1f561b5406becc45734b64d4eb2a253c108ca0
Sep 11 13:05:05.358243 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.358213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"]
Sep 11 13:05:05.360645 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:05:05.360612    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7e66d4_acd7_4a57_a313_a43139ddfb9a.slice/crio-f1c9d6eecb78daaa25f981dbb4869c10063929d613c37d22a716c49ed6612037 WatchSource:0}: Error finding container f1c9d6eecb78daaa25f981dbb4869c10063929d613c37d22a716c49ed6612037: Status 404 returned error can't find the container with id f1c9d6eecb78daaa25f981dbb4869c10063929d613c37d22a716c49ed6612037
Sep 11 13:05:05.812528 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.812487    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt" event={"ID":"ae7e66d4-acd7-4a57-a313-a43139ddfb9a","Type":"ContainerStarted","Data":"1a57ef1754efa1445c8c84d8aaa8679a1fcfddda06adb8295a8aae00e435d6e7"}
Sep 11 13:05:05.812528 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.812536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt" event={"ID":"ae7e66d4-acd7-4a57-a313-a43139ddfb9a","Type":"ContainerStarted","Data":"f1c9d6eecb78daaa25f981dbb4869c10063929d613c37d22a716c49ed6612037"}
Sep 11 13:05:05.813025 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.812615    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:05.814231 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.814197    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv" event={"ID":"2ad3455e-9efb-468b-97aa-f49fb94af722","Type":"ContainerStarted","Data":"1137b3ea8755ad48df6ddc5d923fa87521b7ba857e5f071d155b3ff98c2dbe82"}
Sep 11 13:05:05.814368 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.814238    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv" event={"ID":"2ad3455e-9efb-468b-97aa-f49fb94af722","Type":"ContainerStarted","Data":"692db5efd3467c7383b1d1eaee1f561b5406becc45734b64d4eb2a253c108ca0"}
Sep 11 13:05:05.814368 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.814263    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:05.839973 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.839906    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt" podStartSLOduration=1.839885048 podStartE2EDuration="1.839885048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:05:05.837777662 +0000 UTC m=+1070.217303599" watchObservedRunningTime="2026-09-11 13:05:05.839885048 +0000 UTC m=+1070.219410986"
Sep 11 13:05:05.861177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:05.861121    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv" podStartSLOduration=1.861104955 podStartE2EDuration="1.861104955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:05:05.859365939 +0000 UTC m=+1070.238891878" watchObservedRunningTime="2026-09-11 13:05:05.861104955 +0000 UTC m=+1070.240630925"
Sep 11 13:05:15.868534 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:15.868502    2572 generic.go:356] "Generic (PLEG): container finished" podID="cfc98155-bb45-4211-b328-1b461be58ac0" containerID="85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f" exitCode=0
Sep 11 13:05:15.868965 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:15.868575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" event={"ID":"cfc98155-bb45-4211-b328-1b461be58ac0","Type":"ContainerDied","Data":"85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f"}
Sep 11 13:05:15.869012 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:15.868986    2572 scope.go:117] "RemoveContainer" containerID="85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f"
Sep 11 13:05:15.870035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:15.870008    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:05:15.870090 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:15.870078    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:05:15.870127 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:15.870111    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:05:16.822016 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:16.821988    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:05:16.822272 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:16.822055    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:05:16.877196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:16.877163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" event={"ID":"cfc98155-bb45-4211-b328-1b461be58ac0","Type":"ContainerStarted","Data":"332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73"}
Sep 11 13:05:17.727816 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:17.727776    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:05:17.728064 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:17.728041    2572 patch_prober.go:28] interesting pod/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:05:17.728118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:17.728094    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 13:05:18.728415 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:18.728372    2572 patch_prober.go:28] interesting pod/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:05:18.728802 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:18.728439    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 13:05:19.728247 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:19.728208    2572 patch_prober.go:28] interesting pod/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:05:19.728463 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:19.728263    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 13:05:20.728082 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:20.728045    2572 patch_prober.go:28] interesting pod/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:05:20.728279 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:20.728107    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 13:05:21.727813 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:21.727776    2572 patch_prober.go:28] interesting pod/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:05:21.728203 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:21.727835    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 11 13:05:22.733774 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:22.733741    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:05:22.734170 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:22.734148    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:05:22.734875 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:22.734854    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:05:38.108882 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:38.108784    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"]
Sep 11 13:05:38.109286 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:38.109076    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy" containerID="cri-o://332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73" gracePeriod=30
Sep 11 13:05:43.353709 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.353680    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:05:43.536043 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc98155-bb45-4211-b328-1b461be58ac0-istio-podinfo\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536249 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536072    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc98155-bb45-4211-b328-1b461be58ac0-istiod-ca-cert\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536249 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536104    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-socket\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536249 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536125    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-envoy\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536249 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536142    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-istio-token\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536249 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536232    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-certs\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536268    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85lls\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-kube-api-access-85lls\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536295    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-credential-socket\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536360    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-data\") pod \"cfc98155-bb45-4211-b328-1b461be58ac0\" (UID: \"cfc98155-bb45-4211-b328-1b461be58ac0\") "
Sep 11 13:05:43.536563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:43.536765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536601    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfc98155-bb45-4211-b328-1b461be58ac0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:05:43.536765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536697    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:43.536868 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536797    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:43.536868 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536816    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.536868 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536821    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:43.536868 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536858    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfc98155-bb45-4211-b328-1b461be58ac0-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.536999 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.536873    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.538645 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.538615    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:05:43.538645 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.538631    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-kube-api-access-85lls" (OuterVolumeSpecName: "kube-api-access-85lls") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "kube-api-access-85lls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:05:43.538843 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.538827    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfc98155-bb45-4211-b328-1b461be58ac0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:05:43.538955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.538933    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfc98155-bb45-4211-b328-1b461be58ac0" (UID: "cfc98155-bb45-4211-b328-1b461be58ac0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:05:43.637501 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.637463    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.637501 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.637495    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85lls\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-kube-api-access-85lls\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.637501 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.637507    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.637752 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.637521    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfc98155-bb45-4211-b328-1b461be58ac0-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.637752 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.637532    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfc98155-bb45-4211-b328-1b461be58ac0-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:43.637752 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:43.637542    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfc98155-bb45-4211-b328-1b461be58ac0-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:05:44.024852 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.024821    2572 generic.go:356] "Generic (PLEG): container finished" podID="cfc98155-bb45-4211-b328-1b461be58ac0" containerID="332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73" exitCode=0
Sep 11 13:05:44.025040 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.024867    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"
Sep 11 13:05:44.025040 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.024915    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" event={"ID":"cfc98155-bb45-4211-b328-1b461be58ac0","Type":"ContainerDied","Data":"332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73"}
Sep 11 13:05:44.025040 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.024968    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2" event={"ID":"cfc98155-bb45-4211-b328-1b461be58ac0","Type":"ContainerDied","Data":"8778b21dd4e792a6131a45fce8aa6424d202c526d59d88533aea81a9fe3d0931"}
Sep 11 13:05:44.025040 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.024995    2572 scope.go:117] "RemoveContainer" containerID="332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73"
Sep 11 13:05:44.034643 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.034626    2572 scope.go:117] "RemoveContainer" containerID="85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f"
Sep 11 13:05:44.042967 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.042945    2572 scope.go:117] "RemoveContainer" containerID="332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73"
Sep 11 13:05:44.043280 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:05:44.043261    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73\": container with ID starting with 332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73 not found: ID does not exist" containerID="332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73"
Sep 11 13:05:44.043358 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.043288    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73"} err="failed to get container status \"332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73\": rpc error: code = NotFound desc = could not find container \"332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73\": container with ID starting with 332dc46cb03e22c3f0be07b2c7efc368067b1b5f097640e7acd9cc7c95c68f73 not found: ID does not exist"
Sep 11 13:05:44.043358 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.043306    2572 scope.go:117] "RemoveContainer" containerID="85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f"
Sep 11 13:05:44.043597 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:05:44.043580    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f\": container with ID starting with 85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f not found: ID does not exist" containerID="85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f"
Sep 11 13:05:44.043647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.043600    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f"} err="failed to get container status \"85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f\": rpc error: code = NotFound desc = could not find container \"85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f\": container with ID starting with 85c2211181244a73e5221b2d14a8373435ca87118a8ed11d85181fb60d2e7f3f not found: ID does not exist"
Sep 11 13:05:44.051820 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.051796    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"]
Sep 11 13:05:44.059994 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.059970    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-25a0b392-openshift-default-b44fb79cb-d5st2"]
Sep 11 13:05:44.140513 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:44.140484    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" path="/var/lib/kubelet/pods/cfc98155-bb45-4211-b328-1b461be58ac0/volumes"
Sep 11 13:05:54.215834 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.215803    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"]
Sep 11 13:05:54.216302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.216194    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy"
Sep 11 13:05:54.216302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.216206    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy"
Sep 11 13:05:54.216302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.216220    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy"
Sep 11 13:05:54.216302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.216224    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy"
Sep 11 13:05:54.216302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.216277    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy"
Sep 11 13:05:54.216302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.216284    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc98155-bb45-4211-b328-1b461be58ac0" containerName="istio-proxy"
Sep 11 13:05:54.221250 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.221230    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.224980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.224962    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3dec4b\"/\"openshift-service-ca.crt\""
Sep 11 13:05:54.225476 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.225457    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3dec4b\"/\"explicit-model-3dec4b-kserve-self-signed-certs\""
Sep 11 13:05:54.225751 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.225732    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-3dec4b\"/\"default-dockercfg-n2grm\""
Sep 11 13:05:54.225852 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.225834    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-3dec4b\"/\"kube-root-ca.crt\""
Sep 11 13:05:54.234946 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.234923    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"]
Sep 11 13:05:54.335052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.335010    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/422ecddc-fea1-4f88-9949-874ddba9b473-tls-certs\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.335052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.335048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vflcv\" (UniqueName: \"kubernetes.io/projected/422ecddc-fea1-4f88-9949-874ddba9b473-kube-api-access-vflcv\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.335270 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.335073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-dshm\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.335270 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.335114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-model-cache\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.335270 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.335165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-home\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.335270 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.335220    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-tmp-dir\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.436480 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.436442    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/422ecddc-fea1-4f88-9949-874ddba9b473-tls-certs\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.436480 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.436481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vflcv\" (UniqueName: \"kubernetes.io/projected/422ecddc-fea1-4f88-9949-874ddba9b473-kube-api-access-vflcv\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.436714 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.436501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-dshm\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.436714 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.436520    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-model-cache\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.436714 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.436543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-home\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.436714 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.436599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-tmp-dir\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.437041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.437019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-tmp-dir\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.437105 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.437032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-model-cache\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.437105 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.437060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-home\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.438993 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.438970    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-dshm\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.439236 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.439217    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/422ecddc-fea1-4f88-9949-874ddba9b473-tls-certs\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.445460 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.445429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vflcv\" (UniqueName: \"kubernetes.io/projected/422ecddc-fea1-4f88-9949-874ddba9b473-kube-api-access-vflcv\") pod \"explicit-model-3dec4b-kserve-568fbf7f47-kxdm8\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") " pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.530374 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.530246    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:05:54.805683 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:54.805658    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"]
Sep 11 13:05:54.808131 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:05:54.808107    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod422ecddc_fea1_4f88_9949_874ddba9b473.slice/crio-8a309cec4f7bb89f326b7d9658d7deb57e718de4c910c018a4346eb774be7ec4 WatchSource:0}: Error finding container 8a309cec4f7bb89f326b7d9658d7deb57e718de4c910c018a4346eb774be7ec4: Status 404 returned error can't find the container with id 8a309cec4f7bb89f326b7d9658d7deb57e718de4c910c018a4346eb774be7ec4
Sep 11 13:05:55.083855 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:55.083764    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8" event={"ID":"422ecddc-fea1-4f88-9949-874ddba9b473","Type":"ContainerStarted","Data":"709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820"}
Sep 11 13:05:55.083855 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:55.083810    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8" event={"ID":"422ecddc-fea1-4f88-9949-874ddba9b473","Type":"ContainerStarted","Data":"8a309cec4f7bb89f326b7d9658d7deb57e718de4c910c018a4346eb774be7ec4"}
Sep 11 13:05:55.101946 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:05:55.101886    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8" podStartSLOduration=1.101863359 podStartE2EDuration="1.101863359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:05:55.100462989 +0000 UTC m=+1119.479988962" watchObservedRunningTime="2026-09-11 13:05:55.101863359 +0000 UTC m=+1119.481389296"
Sep 11 13:06:04.531303 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:04.531263    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:06:04.531823 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:04.531344    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:06:04.544169 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:04.544138    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:06:05.143933 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:05.143902    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:06:14.299260 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.299213    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"]
Sep 11 13:06:14.440380 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.440347    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"]
Sep 11 13:06:14.443692 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.443676    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"
Sep 11 13:06:14.445801 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.445774    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:06:14.445801 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.445795    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:06:14.452542 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.452514    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"]
Sep 11 13:06:14.524139 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.524098    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c8684f-7b4c-4609-be70-d8b6899c6eb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg\" (UID: \"12c8684f-7b4c-4609-be70-d8b6899c6eb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"
Sep 11 13:06:14.625258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.625157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c8684f-7b4c-4609-be70-d8b6899c6eb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg\" (UID: \"12c8684f-7b4c-4609-be70-d8b6899c6eb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"
Sep 11 13:06:14.626014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.625988    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c8684f-7b4c-4609-be70-d8b6899c6eb3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg\" (UID: \"12c8684f-7b4c-4609-be70-d8b6899c6eb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"
Sep 11 13:06:14.763138 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:14.763095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"
Sep 11 13:06:15.037299 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:15.037271    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"]
Sep 11 13:06:15.041045 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:06:15.041023    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c8684f_7b4c_4609_be70_d8b6899c6eb3.slice/crio-d95c12484cb27b5fe68df631bd5db891fa821eea3744c4b939ca13fb937a67a6 WatchSource:0}: Error finding container d95c12484cb27b5fe68df631bd5db891fa821eea3744c4b939ca13fb937a67a6: Status 404 returned error can't find the container with id d95c12484cb27b5fe68df631bd5db891fa821eea3744c4b939ca13fb937a67a6
Sep 11 13:06:15.190279 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:15.190245    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg" event={"ID":"12c8684f-7b4c-4609-be70-d8b6899c6eb3","Type":"ContainerStarted","Data":"d95c12484cb27b5fe68df631bd5db891fa821eea3744c4b939ca13fb937a67a6"}
Sep 11 13:06:16.197069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:16.197038    2572 generic.go:356] "Generic (PLEG): container finished" podID="12c8684f-7b4c-4609-be70-d8b6899c6eb3" containerID="016cdea02e8acb91172db0ff65b2d779c4741e4c3163d1d2e5de11ef2d4dff9f" exitCode=0
Sep 11 13:06:16.197433 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:16.197084    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg" event={"ID":"12c8684f-7b4c-4609-be70-d8b6899c6eb3","Type":"ContainerDied","Data":"016cdea02e8acb91172db0ff65b2d779c4741e4c3163d1d2e5de11ef2d4dff9f"}
Sep 11 13:06:17.336115 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:17.336088    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"
Sep 11 13:06:17.452117 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:17.452029    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c8684f-7b4c-4609-be70-d8b6899c6eb3-maas-api-service-ca\") pod \"12c8684f-7b4c-4609-be70-d8b6899c6eb3\" (UID: \"12c8684f-7b4c-4609-be70-d8b6899c6eb3\") "
Sep 11 13:06:17.452487 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:17.452466    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12c8684f-7b4c-4609-be70-d8b6899c6eb3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12c8684f-7b4c-4609-be70-d8b6899c6eb3" (UID: "12c8684f-7b4c-4609-be70-d8b6899c6eb3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:06:17.553761 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:17.553723    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c8684f-7b4c-4609-be70-d8b6899c6eb3-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:18.207175 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:18.207140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg" event={"ID":"12c8684f-7b4c-4609-be70-d8b6899c6eb3","Type":"ContainerDied","Data":"d95c12484cb27b5fe68df631bd5db891fa821eea3744c4b939ca13fb937a67a6"}
Sep 11 13:06:18.207372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:18.207186    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"
Sep 11 13:06:18.207372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:18.207199    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d95c12484cb27b5fe68df631bd5db891fa821eea3744c4b939ca13fb937a67a6"
Sep 11 13:06:25.064818 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.064778    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"]
Sep 11 13:06:25.065433 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.065005    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt" podUID="ae7e66d4-acd7-4a57-a313-a43139ddfb9a" containerName="payload-processing" containerID="cri-o://1a57ef1754efa1445c8c84d8aaa8679a1fcfddda06adb8295a8aae00e435d6e7" gracePeriod=30
Sep 11 13:06:25.069208 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.069180    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"]
Sep 11 13:06:25.069467 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.069421    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv" podUID="2ad3455e-9efb-468b-97aa-f49fb94af722" containerName="payload-pre-processing" containerID="cri-o://1137b3ea8755ad48df6ddc5d923fa87521b7ba857e5f071d155b3ff98c2dbe82" gracePeriod=30
Sep 11 13:06:25.266788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.257648    2572 generic.go:356] "Generic (PLEG): container finished" podID="ae7e66d4-acd7-4a57-a313-a43139ddfb9a" containerID="1a57ef1754efa1445c8c84d8aaa8679a1fcfddda06adb8295a8aae00e435d6e7" exitCode=0
Sep 11 13:06:25.266788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.257760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt" event={"ID":"ae7e66d4-acd7-4a57-a313-a43139ddfb9a","Type":"ContainerDied","Data":"1a57ef1754efa1445c8c84d8aaa8679a1fcfddda06adb8295a8aae00e435d6e7"}
Sep 11 13:06:25.266788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.260239    2572 generic.go:356] "Generic (PLEG): container finished" podID="2ad3455e-9efb-468b-97aa-f49fb94af722" containerID="1137b3ea8755ad48df6ddc5d923fa87521b7ba857e5f071d155b3ff98c2dbe82" exitCode=0
Sep 11 13:06:25.266788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.260407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv" event={"ID":"2ad3455e-9efb-468b-97aa-f49fb94af722","Type":"ContainerDied","Data":"1137b3ea8755ad48df6ddc5d923fa87521b7ba857e5f071d155b3ff98c2dbe82"}
Sep 11 13:06:25.285511 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.284889    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"]
Sep 11 13:06:25.289392 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.288648    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-3dec4b-bqxjg"]
Sep 11 13:06:25.336919 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.336897    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:06:25.373788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.373762    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:06:25.529274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.529237    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtzkz\" (UniqueName: \"kubernetes.io/projected/2ad3455e-9efb-468b-97aa-f49fb94af722-kube-api-access-qtzkz\") pod \"2ad3455e-9efb-468b-97aa-f49fb94af722\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") "
Sep 11 13:06:25.529274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.529274    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kd6\" (UniqueName: \"kubernetes.io/projected/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-kube-api-access-c9kd6\") pod \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") "
Sep 11 13:06:25.529558 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.529307    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ad3455e-9efb-468b-97aa-f49fb94af722-plugins-config-volume\") pod \"2ad3455e-9efb-468b-97aa-f49fb94af722\" (UID: \"2ad3455e-9efb-468b-97aa-f49fb94af722\") "
Sep 11 13:06:25.529558 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.529440    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-plugins-config-volume\") pod \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\" (UID: \"ae7e66d4-acd7-4a57-a313-a43139ddfb9a\") "
Sep 11 13:06:25.529750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.529716    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ad3455e-9efb-468b-97aa-f49fb94af722-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ad3455e-9efb-468b-97aa-f49fb94af722" (UID: "2ad3455e-9efb-468b-97aa-f49fb94af722"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:06:25.529867 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.529763    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae7e66d4-acd7-4a57-a313-a43139ddfb9a" (UID: "ae7e66d4-acd7-4a57-a313-a43139ddfb9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:06:25.531641 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.531615    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ad3455e-9efb-468b-97aa-f49fb94af722-kube-api-access-qtzkz" (OuterVolumeSpecName: "kube-api-access-qtzkz") pod "2ad3455e-9efb-468b-97aa-f49fb94af722" (UID: "2ad3455e-9efb-468b-97aa-f49fb94af722"). InnerVolumeSpecName "kube-api-access-qtzkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:06:25.531727 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.531658    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-kube-api-access-c9kd6" (OuterVolumeSpecName: "kube-api-access-c9kd6") pod "ae7e66d4-acd7-4a57-a313-a43139ddfb9a" (UID: "ae7e66d4-acd7-4a57-a313-a43139ddfb9a"). InnerVolumeSpecName "kube-api-access-c9kd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:06:25.631141 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.631075    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtzkz\" (UniqueName: \"kubernetes.io/projected/2ad3455e-9efb-468b-97aa-f49fb94af722-kube-api-access-qtzkz\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:25.631141 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.631099    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kd6\" (UniqueName: \"kubernetes.io/projected/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-kube-api-access-c9kd6\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:25.631141 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.631110    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ad3455e-9efb-468b-97aa-f49fb94af722-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:25.631141 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:25.631118    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7e66d4-acd7-4a57-a313-a43139ddfb9a-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:26.141228 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.141154    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12c8684f-7b4c-4609-be70-d8b6899c6eb3" path="/var/lib/kubelet/pods/12c8684f-7b4c-4609-be70-d8b6899c6eb3/volumes"
Sep 11 13:06:26.269420 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.269383    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt" event={"ID":"ae7e66d4-acd7-4a57-a313-a43139ddfb9a","Type":"ContainerDied","Data":"f1c9d6eecb78daaa25f981dbb4869c10063929d613c37d22a716c49ed6612037"}
Sep 11 13:06:26.269420 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.269417    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"
Sep 11 13:06:26.269654 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.269465    2572 scope.go:117] "RemoveContainer" containerID="1a57ef1754efa1445c8c84d8aaa8679a1fcfddda06adb8295a8aae00e435d6e7"
Sep 11 13:06:26.270925 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.270868    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"
Sep 11 13:06:26.271008 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.270879    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv" event={"ID":"2ad3455e-9efb-468b-97aa-f49fb94af722","Type":"ContainerDied","Data":"692db5efd3467c7383b1d1eaee1f561b5406becc45734b64d4eb2a253c108ca0"}
Sep 11 13:06:26.280389 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.280371    2572 scope.go:117] "RemoveContainer" containerID="1137b3ea8755ad48df6ddc5d923fa87521b7ba857e5f071d155b3ff98c2dbe82"
Sep 11 13:06:26.288286 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.288263    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"]
Sep 11 13:06:26.293111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.293087    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-3dec4b-fd75d9c45-h6lnt"]
Sep 11 13:06:26.303486 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.303455    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"]
Sep 11 13:06:26.309952 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:26.309932    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-3dec4b-57f745ccc8-5rcpv"]
Sep 11 13:06:28.139972 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:28.139937    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ad3455e-9efb-468b-97aa-f49fb94af722" path="/var/lib/kubelet/pods/2ad3455e-9efb-468b-97aa-f49fb94af722/volumes"
Sep 11 13:06:28.140510 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:28.140490    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae7e66d4-acd7-4a57-a313-a43139ddfb9a" path="/var/lib/kubelet/pods/ae7e66d4-acd7-4a57-a313-a43139ddfb9a/volumes"
Sep 11 13:06:29.320179 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.320147    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8" podUID="422ecddc-fea1-4f88-9949-874ddba9b473" containerName="main" containerID="cri-o://709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820" gracePeriod=45
Sep 11 13:06:29.569735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.569713    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:06:29.674196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674168    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-dshm\") pod \"422ecddc-fea1-4f88-9949-874ddba9b473\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") "
Sep 11 13:06:29.674413 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674200    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vflcv\" (UniqueName: \"kubernetes.io/projected/422ecddc-fea1-4f88-9949-874ddba9b473-kube-api-access-vflcv\") pod \"422ecddc-fea1-4f88-9949-874ddba9b473\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") "
Sep 11 13:06:29.674413 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674226    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-tmp-dir\") pod \"422ecddc-fea1-4f88-9949-874ddba9b473\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") "
Sep 11 13:06:29.674413 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674244    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/422ecddc-fea1-4f88-9949-874ddba9b473-tls-certs\") pod \"422ecddc-fea1-4f88-9949-874ddba9b473\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") "
Sep 11 13:06:29.674413 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674315    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-model-cache\") pod \"422ecddc-fea1-4f88-9949-874ddba9b473\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") "
Sep 11 13:06:29.674413 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674368    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-home\") pod \"422ecddc-fea1-4f88-9949-874ddba9b473\" (UID: \"422ecddc-fea1-4f88-9949-874ddba9b473\") "
Sep 11 13:06:29.674706 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674558    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "422ecddc-fea1-4f88-9949-874ddba9b473" (UID: "422ecddc-fea1-4f88-9949-874ddba9b473"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:29.674706 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674650    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-model-cache" (OuterVolumeSpecName: "model-cache") pod "422ecddc-fea1-4f88-9949-874ddba9b473" (UID: "422ecddc-fea1-4f88-9949-874ddba9b473"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:29.674811 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.674753    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-home" (OuterVolumeSpecName: "home") pod "422ecddc-fea1-4f88-9949-874ddba9b473" (UID: "422ecddc-fea1-4f88-9949-874ddba9b473"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:29.676700 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.676674    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-dshm" (OuterVolumeSpecName: "dshm") pod "422ecddc-fea1-4f88-9949-874ddba9b473" (UID: "422ecddc-fea1-4f88-9949-874ddba9b473"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:06:29.676798 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.676751    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/422ecddc-fea1-4f88-9949-874ddba9b473-kube-api-access-vflcv" (OuterVolumeSpecName: "kube-api-access-vflcv") pod "422ecddc-fea1-4f88-9949-874ddba9b473" (UID: "422ecddc-fea1-4f88-9949-874ddba9b473"). InnerVolumeSpecName "kube-api-access-vflcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:06:29.676798 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.676768    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/422ecddc-fea1-4f88-9949-874ddba9b473-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "422ecddc-fea1-4f88-9949-874ddba9b473" (UID: "422ecddc-fea1-4f88-9949-874ddba9b473"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:06:29.775387 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.775358    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-model-cache\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:29.775387 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.775383    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-home\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:29.775387 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.775391    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-dshm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:29.775598 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.775399    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vflcv\" (UniqueName: \"kubernetes.io/projected/422ecddc-fea1-4f88-9949-874ddba9b473-kube-api-access-vflcv\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:29.775598 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.775409    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/422ecddc-fea1-4f88-9949-874ddba9b473-tmp-dir\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:29.775598 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:29.775420    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/422ecddc-fea1-4f88-9949-874ddba9b473-tls-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:06:30.295032 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.294999    2572 generic.go:356] "Generic (PLEG): container finished" podID="422ecddc-fea1-4f88-9949-874ddba9b473" containerID="709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820" exitCode=0
Sep 11 13:06:30.295220 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.295048    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"
Sep 11 13:06:30.295220 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.295091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8" event={"ID":"422ecddc-fea1-4f88-9949-874ddba9b473","Type":"ContainerDied","Data":"709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820"}
Sep 11 13:06:30.295220 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.295134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8" event={"ID":"422ecddc-fea1-4f88-9949-874ddba9b473","Type":"ContainerDied","Data":"8a309cec4f7bb89f326b7d9658d7deb57e718de4c910c018a4346eb774be7ec4"}
Sep 11 13:06:30.295220 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.295156    2572 scope.go:117] "RemoveContainer" containerID="709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820"
Sep 11 13:06:30.303788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.303769    2572 scope.go:117] "RemoveContainer" containerID="709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820"
Sep 11 13:06:30.304063 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:06:30.304043    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820\": container with ID starting with 709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820 not found: ID does not exist" containerID="709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820"
Sep 11 13:06:30.304151 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.304070    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820"} err="failed to get container status \"709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820\": rpc error: code = NotFound desc = could not find container \"709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820\": container with ID starting with 709bf2acdb43ded2bc10513cfc9767639e0ed65e805c806f83d454a630022820 not found: ID does not exist"
Sep 11 13:06:30.311748 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.311726    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"]
Sep 11 13:06:30.315366 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:30.315341    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-3dec4b/explicit-model-3dec4b-kserve-568fbf7f47-kxdm8"]
Sep 11 13:06:32.139642 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.139610    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="422ecddc-fea1-4f88-9949-874ddba9b473" path="/var/lib/kubelet/pods/422ecddc-fea1-4f88-9949-874ddba9b473/volumes"
Sep 11 13:06:32.640510 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640476    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"]
Sep 11 13:06:32.640894 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640882    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c8684f-7b4c-4609-be70-d8b6899c6eb3" containerName="revoke-keys"
Sep 11 13:06:32.640949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640897    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c8684f-7b4c-4609-be70-d8b6899c6eb3" containerName="revoke-keys"
Sep 11 13:06:32.640949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640906    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7e66d4-acd7-4a57-a313-a43139ddfb9a" containerName="payload-processing"
Sep 11 13:06:32.640949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640911    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7e66d4-acd7-4a57-a313-a43139ddfb9a" containerName="payload-processing"
Sep 11 13:06:32.640949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640920    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422ecddc-fea1-4f88-9949-874ddba9b473" containerName="main"
Sep 11 13:06:32.640949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640925    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="422ecddc-fea1-4f88-9949-874ddba9b473" containerName="main"
Sep 11 13:06:32.640949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640940    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad3455e-9efb-468b-97aa-f49fb94af722" containerName="payload-pre-processing"
Sep 11 13:06:32.640949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.640949    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad3455e-9efb-468b-97aa-f49fb94af722" containerName="payload-pre-processing"
Sep 11 13:06:32.641153 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.641002    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="422ecddc-fea1-4f88-9949-874ddba9b473" containerName="main"
Sep 11 13:06:32.641153 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.641010    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ad3455e-9efb-468b-97aa-f49fb94af722" containerName="payload-pre-processing"
Sep 11 13:06:32.641153 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.641016    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7e66d4-acd7-4a57-a313-a43139ddfb9a" containerName="payload-processing"
Sep 11 13:06:32.641153 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.641026    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c8684f-7b4c-4609-be70-d8b6899c6eb3" containerName="revoke-keys"
Sep 11 13:06:32.645155 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.645133    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.648504 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.648482    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-bfc1b3-openshift-default-dockercfg-rh2xl\""
Sep 11 13:06:32.664074 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.664047    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"]
Sep 11 13:06:32.702039 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702007    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-credential-socket\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702039 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702039    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-envoy\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702234 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istiod-ca-cert\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702234 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t424\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-kube-api-access-6t424\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702234 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-certs\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702234 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-token\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702393 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-data\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702393 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-socket\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.702393 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.702304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-podinfo\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803147 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-podinfo\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803314 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803165    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-credential-socket\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803314 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-envoy\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803314 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803215    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istiod-ca-cert\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803314 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803239    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t424\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-kube-api-access-6t424\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803314 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-certs\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803314 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-token\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803417    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-data\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803455    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-socket\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-data\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.803887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803871    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-credential-socket\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.804054 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.803910    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-socket\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.804054 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.804021    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-certs\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.804127 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.804113    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istiod-ca-cert\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.805760 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.805740    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-podinfo\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.805917 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.805902    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-envoy\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.811369 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.811348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-token\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.811513 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.811495    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t424\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-kube-api-access-6t424\") pod \"e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") " pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:32.955012 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:32.954984    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:33.233288 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.233215    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"]
Sep 11 13:06:33.236351 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:06:33.236288    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc73c9d_8fb1_40f9_b399_e983cdb765db.slice/crio-c1eb896eb30e3bdd9a4ab25e79d17d169343b9ceee7dbc907a2a14445b735e18 WatchSource:0}: Error finding container c1eb896eb30e3bdd9a4ab25e79d17d169343b9ceee7dbc907a2a14445b735e18: Status 404 returned error can't find the container with id c1eb896eb30e3bdd9a4ab25e79d17d169343b9ceee7dbc907a2a14445b735e18
Sep 11 13:06:33.238560 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.238527    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:06:33.238672 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.238607    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:06:33.238672 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.238653    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:06:33.312560 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.312531    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c" event={"ID":"4cc73c9d-8fb1-40f9-b399-e983cdb765db","Type":"ContainerStarted","Data":"bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d"}
Sep 11 13:06:33.312723 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.312580    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c" event={"ID":"4cc73c9d-8fb1-40f9-b399-e983cdb765db","Type":"ContainerStarted","Data":"c1eb896eb30e3bdd9a4ab25e79d17d169343b9ceee7dbc907a2a14445b735e18"}
Sep 11 13:06:33.336552 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.336487    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c" podStartSLOduration=1.336464399 podStartE2EDuration="1.336464399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:06:33.333613055 +0000 UTC m=+1157.713138994" watchObservedRunningTime="2026-09-11 13:06:33.336464399 +0000 UTC m=+1157.715990337"
Sep 11 13:06:33.955152 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:33.955101    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:34.960309 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:34.960273    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:35.323723 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:35.323642    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:06:35.324866 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:06:35.324850    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:07:11.103524 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:11.103489    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"]
Sep 11 13:07:11.104144 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:11.103795    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c" podUID="4cc73c9d-8fb1-40f9-b399-e983cdb765db" containerName="istio-proxy" containerID="cri-o://bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d" gracePeriod=30
Sep 11 13:07:12.211274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.211236    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"]
Sep 11 13:07:12.215165 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.215144    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"
Sep 11 13:07:12.217406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.217389    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:07:12.217514 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.217389    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:07:12.222943 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.222919    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"]
Sep 11 13:07:12.270119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.270088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2386b468-e4c2-430b-b793-d686c0de2973-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r\" (UID: \"2386b468-e4c2-430b-b793-d686c0de2973\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"
Sep 11 13:07:12.371607 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.371565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2386b468-e4c2-430b-b793-d686c0de2973-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r\" (UID: \"2386b468-e4c2-430b-b793-d686c0de2973\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"
Sep 11 13:07:12.372195 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.372174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2386b468-e4c2-430b-b793-d686c0de2973-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r\" (UID: \"2386b468-e4c2-430b-b793-d686c0de2973\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"
Sep 11 13:07:12.526859 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.526775    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"
Sep 11 13:07:12.802128 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:12.802054    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"]
Sep 11 13:07:12.805078 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:07:12.805048    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2386b468_e4c2_430b_b793_d686c0de2973.slice/crio-ccccc9761c07c2a6bd05d35512b3549f174ab82335d7f3fffd63542cd6c503cd WatchSource:0}: Error finding container ccccc9761c07c2a6bd05d35512b3549f174ab82335d7f3fffd63542cd6c503cd: Status 404 returned error can't find the container with id ccccc9761c07c2a6bd05d35512b3549f174ab82335d7f3fffd63542cd6c503cd
Sep 11 13:07:13.517863 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:13.517814    2572 generic.go:356] "Generic (PLEG): container finished" podID="2386b468-e4c2-430b-b793-d686c0de2973" containerID="60b842fceef8a5213c33f95d73e8a35105fe67147078f1d15ad06aeb0977bce8" exitCode=0
Sep 11 13:07:13.518313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:13.517965    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r" event={"ID":"2386b468-e4c2-430b-b793-d686c0de2973","Type":"ContainerDied","Data":"60b842fceef8a5213c33f95d73e8a35105fe67147078f1d15ad06aeb0977bce8"}
Sep 11 13:07:13.518313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:13.518105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r" event={"ID":"2386b468-e4c2-430b-b793-d686c0de2973","Type":"ContainerStarted","Data":"ccccc9761c07c2a6bd05d35512b3549f174ab82335d7f3fffd63542cd6c503cd"}
Sep 11 13:07:14.660640 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:14.660608    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"
Sep 11 13:07:14.696536 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:14.696505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2386b468-e4c2-430b-b793-d686c0de2973-maas-api-service-ca\") pod \"2386b468-e4c2-430b-b793-d686c0de2973\" (UID: \"2386b468-e4c2-430b-b793-d686c0de2973\") "
Sep 11 13:07:14.696916 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:14.696895    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2386b468-e4c2-430b-b793-d686c0de2973-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2386b468-e4c2-430b-b793-d686c0de2973" (UID: "2386b468-e4c2-430b-b793-d686c0de2973"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:07:14.797567 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:14.797471    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2386b468-e4c2-430b-b793-d686c0de2973-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:15.077964 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.077880    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"]
Sep 11 13:07:15.078258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.078245    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2386b468-e4c2-430b-b793-d686c0de2973" containerName="revoke-keys"
Sep 11 13:07:15.078303 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.078259    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2386b468-e4c2-430b-b793-d686c0de2973" containerName="revoke-keys"
Sep 11 13:07:15.078370 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.078337    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2386b468-e4c2-430b-b793-d686c0de2973" containerName="revoke-keys"
Sep 11 13:07:15.081297 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.081282    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.085245 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.085222    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f294ac01-openshift-default-dockercfg-k8zlr\""
Sep 11 13:07:15.095594 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.095563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"]
Sep 11 13:07:15.201739 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.201699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-socket\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.201739 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.201743    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-token\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.201991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.201799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhb4\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-kube-api-access-jrhb4\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.201991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.201833    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-credential-socket\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.201991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.201883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-podinfo\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.202171 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.201998    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-data\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.202171 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.202044    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-certs\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.202171 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.202136    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-envoy\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.202342 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.202212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istiod-ca-cert\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303179 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-socket\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303179 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-token\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303197    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhb4\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-kube-api-access-jrhb4\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-credential-socket\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303248    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-podinfo\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303276    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-data\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303303    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-certs\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-envoy\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istiod-ca-cert\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303807 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-socket\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303807 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303692    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-data\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303807 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303744    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-certs\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.303913 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.303823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-credential-socket\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.304286 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.304265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istiod-ca-cert\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.305821 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.305805    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-envoy\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.306049 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.306032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-podinfo\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.312286 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.312258    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhb4\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-kube-api-access-jrhb4\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.312493 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.312476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-token\") pod \"e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") " pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.391511 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.391429    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:15.529625 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.529586    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r" event={"ID":"2386b468-e4c2-430b-b793-d686c0de2973","Type":"ContainerDied","Data":"ccccc9761c07c2a6bd05d35512b3549f174ab82335d7f3fffd63542cd6c503cd"}
Sep 11 13:07:15.529625 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.529611    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"
Sep 11 13:07:15.529833 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.529642    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccccc9761c07c2a6bd05d35512b3549f174ab82335d7f3fffd63542cd6c503cd"
Sep 11 13:07:15.684528 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.684495    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"]
Sep 11 13:07:15.687601 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:07:15.687570    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb038f81d_ded5_4d8a_b34f_0e1922618e7f.slice/crio-26bae42b6aa16d5ccda6dddd76dfce1c96c80c1072e41d18520a932a51e8fa20 WatchSource:0}: Error finding container 26bae42b6aa16d5ccda6dddd76dfce1c96c80c1072e41d18520a932a51e8fa20: Status 404 returned error can't find the container with id 26bae42b6aa16d5ccda6dddd76dfce1c96c80c1072e41d18520a932a51e8fa20
Sep 11 13:07:15.689893 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.689848    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:07:15.689997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.689935    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:07:15.689997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:15.689979    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:07:16.120014 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.119984    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:07:16.123519 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.123500    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:07:16.341064 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.341041    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:07:16.413605 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413565    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-socket\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.413814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413617    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-data\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.413814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413687    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-envoy\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.413814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413710    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istiod-ca-cert\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.413814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413731    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-token\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.413814 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413771    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t424\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-kube-api-access-6t424\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.414069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413832    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-certs\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.414069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413866    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-credential-socket\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.414069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413901    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:16.414069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413955    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-data" (OuterVolumeSpecName: "istio-data") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:16.414069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.413989    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-podinfo\") pod \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\" (UID: \"4cc73c9d-8fb1-40f9-b399-e983cdb765db\") "
Sep 11 13:07:16.414346 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414097    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:16.414346 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414162    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:16.414346 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414185    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:07:16.414346 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414310    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.414730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414357    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.414730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414367    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.414730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414375    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.414730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.414382    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.416080 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.416054    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:16.416179 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.416110    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:07:16.416179 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.416114    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:16.416255 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.416184    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-kube-api-access-6t424" (OuterVolumeSpecName: "kube-api-access-6t424") pod "4cc73c9d-8fb1-40f9-b399-e983cdb765db" (UID: "4cc73c9d-8fb1-40f9-b399-e983cdb765db"). InnerVolumeSpecName "kube-api-access-6t424". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:16.515644 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.515611    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.515644 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.515637    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.515644 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.515646    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.515873 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.515654    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t424\" (UniqueName: \"kubernetes.io/projected/4cc73c9d-8fb1-40f9-b399-e983cdb765db-kube-api-access-6t424\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:16.536405 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.536364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" event={"ID":"b038f81d-ded5-4d8a-b34f-0e1922618e7f","Type":"ContainerStarted","Data":"57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca"}
Sep 11 13:07:16.536563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.536454    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" event={"ID":"b038f81d-ded5-4d8a-b34f-0e1922618e7f","Type":"ContainerStarted","Data":"26bae42b6aa16d5ccda6dddd76dfce1c96c80c1072e41d18520a932a51e8fa20"}
Sep 11 13:07:16.537750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.537726    2572 generic.go:356] "Generic (PLEG): container finished" podID="4cc73c9d-8fb1-40f9-b399-e983cdb765db" containerID="bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d" exitCode=0
Sep 11 13:07:16.537840 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.537766    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c" event={"ID":"4cc73c9d-8fb1-40f9-b399-e983cdb765db","Type":"ContainerDied","Data":"bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d"}
Sep 11 13:07:16.537840 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.537782    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"
Sep 11 13:07:16.537840 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.537801    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c" event={"ID":"4cc73c9d-8fb1-40f9-b399-e983cdb765db","Type":"ContainerDied","Data":"c1eb896eb30e3bdd9a4ab25e79d17d169343b9ceee7dbc907a2a14445b735e18"}
Sep 11 13:07:16.537840 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.537823    2572 scope.go:117] "RemoveContainer" containerID="bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d"
Sep 11 13:07:16.547253 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.547235    2572 scope.go:117] "RemoveContainer" containerID="bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d"
Sep 11 13:07:16.547555 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:07:16.547536    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d\": container with ID starting with bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d not found: ID does not exist" containerID="bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d"
Sep 11 13:07:16.547610 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.547562    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d"} err="failed to get container status \"bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d\": rpc error: code = NotFound desc = could not find container \"bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d\": container with ID starting with bdb74863d59e00d2d1ee4533d5a5a9269226a5df7ff6105509143b8ab2771e3d not found: ID does not exist"
Sep 11 13:07:16.563501 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.563457    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podStartSLOduration=1.563444346 podStartE2EDuration="1.563444346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:07:16.562278959 +0000 UTC m=+1200.941804917" watchObservedRunningTime="2026-09-11 13:07:16.563444346 +0000 UTC m=+1200.942970282"
Sep 11 13:07:16.612764 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.612728    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"]
Sep 11 13:07:16.615524 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:16.615492    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-bfc1b3-openshift-default-759f78cf78-d7t7c"]
Sep 11 13:07:17.392583 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:17.392545    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:17.397211 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:17.397186    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:17.544930 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:17.544901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:17.545907 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:17.545886    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:18.140300 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:18.140270    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cc73c9d-8fb1-40f9-b399-e983cdb765db" path="/var/lib/kubelet/pods/4cc73c9d-8fb1-40f9-b399-e983cdb765db/volumes"
Sep 11 13:07:20.584861 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.584822    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"]
Sep 11 13:07:20.585258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.585188    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc73c9d-8fb1-40f9-b399-e983cdb765db" containerName="istio-proxy"
Sep 11 13:07:20.585258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.585198    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc73c9d-8fb1-40f9-b399-e983cdb765db" containerName="istio-proxy"
Sep 11 13:07:20.585358 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.585270    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc73c9d-8fb1-40f9-b399-e983cdb765db" containerName="istio-proxy"
Sep 11 13:07:20.589900 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.589881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.592453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.592422    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f294ac01\""
Sep 11 13:07:20.592453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.592447    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f294ac01-dockercfg-ltp6s\""
Sep 11 13:07:20.599492 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.599468    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"]
Sep 11 13:07:20.651632 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.651599    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"]
Sep 11 13:07:20.654912 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.654893    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:20.655156 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.655136    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-plugins-config-volume\") pod \"payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") " pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.655209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.655191    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxhlj\" (UniqueName: \"kubernetes.io/projected/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-kube-api-access-hxhlj\") pod \"payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") " pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.666405 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.666383    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"]
Sep 11 13:07:20.755897 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.755844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8pd\" (UniqueName: \"kubernetes.io/projected/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-kube-api-access-hm8pd\") pod \"payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:20.756067 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.755913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-plugins-config-volume\") pod \"payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") " pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.756067 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.755982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxhlj\" (UniqueName: \"kubernetes.io/projected/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-kube-api-access-hxhlj\") pod \"payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") " pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.756067 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.756001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:20.756620 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.756602    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-plugins-config-volume\") pod \"payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") " pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.766205 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.766183    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxhlj\" (UniqueName: \"kubernetes.io/projected/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-kube-api-access-hxhlj\") pod \"payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") " pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.857447 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.857369    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:20.857592 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.857461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8pd\" (UniqueName: \"kubernetes.io/projected/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-kube-api-access-hm8pd\") pod \"payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:20.858127 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.858107    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:20.866930 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.866902    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8pd\" (UniqueName: \"kubernetes.io/projected/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-kube-api-access-hm8pd\") pod \"payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:20.900845 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.900808    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:20.966536 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:20.966500    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:21.214845 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.214821    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"]
Sep 11 13:07:21.216162 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:07:21.216134    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebeb8ee_1d6c_4e41_8360_035c119ecbe8.slice/crio-63aca6a81dca12afec2f8496f72c2f0ac9dacd19c2697a8f83ed17f37b323956 WatchSource:0}: Error finding container 63aca6a81dca12afec2f8496f72c2f0ac9dacd19c2697a8f83ed17f37b323956: Status 404 returned error can't find the container with id 63aca6a81dca12afec2f8496f72c2f0ac9dacd19c2697a8f83ed17f37b323956
Sep 11 13:07:21.253702 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.253663    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"]
Sep 11 13:07:21.254524 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:07:21.254497    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f176c0d_3cc8_45f2_a822_3bfb1bb088f9.slice/crio-af0b4a2b738a8aae33c8bb4a8a820a6052b0fd68e156c53a8956032ec4ffda94 WatchSource:0}: Error finding container af0b4a2b738a8aae33c8bb4a8a820a6052b0fd68e156c53a8956032ec4ffda94: Status 404 returned error can't find the container with id af0b4a2b738a8aae33c8bb4a8a820a6052b0fd68e156c53a8956032ec4ffda94
Sep 11 13:07:21.571050 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.570924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd" event={"ID":"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9","Type":"ContainerStarted","Data":"b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e"}
Sep 11 13:07:21.571050 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.571015    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:21.571050 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.571045    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd" event={"ID":"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9","Type":"ContainerStarted","Data":"af0b4a2b738a8aae33c8bb4a8a820a6052b0fd68e156c53a8956032ec4ffda94"}
Sep 11 13:07:21.572572 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.572544    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2" event={"ID":"cebeb8ee-1d6c-4e41-8360-035c119ecbe8","Type":"ContainerStarted","Data":"b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b"}
Sep 11 13:07:21.572673 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.572599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:21.572673 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.572626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2" event={"ID":"cebeb8ee-1d6c-4e41-8360-035c119ecbe8","Type":"ContainerStarted","Data":"63aca6a81dca12afec2f8496f72c2f0ac9dacd19c2697a8f83ed17f37b323956"}
Sep 11 13:07:21.590483 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.590432    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd" podStartSLOduration=1.590406819 podStartE2EDuration="1.590406819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:07:21.588234861 +0000 UTC m=+1205.967760798" watchObservedRunningTime="2026-09-11 13:07:21.590406819 +0000 UTC m=+1205.969932813"
Sep 11 13:07:21.606915 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:21.606854    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2" podStartSLOduration=1.6068314529999999 podStartE2EDuration="1.606831453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:07:21.605713148 +0000 UTC m=+1205.985239086" watchObservedRunningTime="2026-09-11 13:07:21.606831453 +0000 UTC m=+1205.986357391"
Sep 11 13:07:22.588136 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:22.588101    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"]
Sep 11 13:07:22.590980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:22.590957    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0e2299-mxz4r"]
Sep 11 13:07:24.145707 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:24.145675    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2386b468-e4c2-430b-b793-d686c0de2973" path="/var/lib/kubelet/pods/2386b468-e4c2-430b-b793-d686c0de2973/volumes"
Sep 11 13:07:29.141802 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:29.141760    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"]
Sep 11 13:07:29.142569 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:29.142541    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" containerID="cri-o://8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6" gracePeriod=30
Sep 11 13:07:30.615710 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:30.615668    2572 patch_prober.go:28] interesting pod/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:07:30.616080 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:30.615742    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:07:32.579536 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:32.579505    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:07:32.579922 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:32.579693    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:07:34.405126 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.405043    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:07:34.486831 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.486790    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-certs\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.486856    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnvp2\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-kube-api-access-vnvp2\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.486907    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-podinfo\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.486949    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-token\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.486987    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-socket\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487011    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-credential-socket\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487110    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:34.487302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487166    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-envoy\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487204    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istiod-ca-cert\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487236    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-data\") pod \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\" (UID: \"d626bdbc-eb78-43d4-8290-ac8c95f4781e\") "
Sep 11 13:07:34.487550 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487406    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:34.487716 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487681    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:34.487791 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487719    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:07:34.487791 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487740    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.487791 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487766    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.488142 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.487862    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:34.489688 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.489655    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:34.489854 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.489823    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-kube-api-access-vnvp2" (OuterVolumeSpecName: "kube-api-access-vnvp2") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "kube-api-access-vnvp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:34.490128 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.490101    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:07:34.490203 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.490107    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d626bdbc-eb78-43d4-8290-ac8c95f4781e" (UID: "d626bdbc-eb78-43d4-8290-ac8c95f4781e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:34.588281 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.588239    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.588281 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.588273    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.588281 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.588282    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.588281 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.588290    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.588619 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.588300    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnvp2\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-kube-api-access-vnvp2\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.588619 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.588308    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.588619 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.588328    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d626bdbc-eb78-43d4-8290-ac8c95f4781e-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:34.651537 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.651496    2572 generic.go:356] "Generic (PLEG): container finished" podID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerID="8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6" exitCode=0
Sep 11 13:07:34.651701 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.651559    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"
Sep 11 13:07:34.651701 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.651580    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" event={"ID":"d626bdbc-eb78-43d4-8290-ac8c95f4781e","Type":"ContainerDied","Data":"8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6"}
Sep 11 13:07:34.651701 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.651637    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5" event={"ID":"d626bdbc-eb78-43d4-8290-ac8c95f4781e","Type":"ContainerDied","Data":"01659fce959e4cfeb1cb1f380689177d303971b8cec28c4c34c006cd632185b3"}
Sep 11 13:07:34.651701 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.651660    2572 scope.go:117] "RemoveContainer" containerID="8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6"
Sep 11 13:07:34.661285 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.661260    2572 scope.go:117] "RemoveContainer" containerID="3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be"
Sep 11 13:07:34.670003 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.669981    2572 scope.go:117] "RemoveContainer" containerID="8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6"
Sep 11 13:07:34.670335 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:07:34.670294    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6\": container with ID starting with 8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6 not found: ID does not exist" containerID="8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6"
Sep 11 13:07:34.670441 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.670341    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6"} err="failed to get container status \"8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6\": rpc error: code = NotFound desc = could not find container \"8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6\": container with ID starting with 8660798a806a82c55d751bbfaaf9bc3fbf4c7644c0bcfc6655fd2f00d3564ef6 not found: ID does not exist"
Sep 11 13:07:34.670441 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.670361    2572 scope.go:117] "RemoveContainer" containerID="3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be"
Sep 11 13:07:34.670639 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:07:34.670620    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be\": container with ID starting with 3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be not found: ID does not exist" containerID="3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be"
Sep 11 13:07:34.670693 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.670645    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be"} err="failed to get container status \"3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be\": rpc error: code = NotFound desc = could not find container \"3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be\": container with ID starting with 3761037edcf4224d48d773a9712994a46bbb04eaaa1de5b157db851a272a78be not found: ID does not exist"
Sep 11 13:07:34.674600 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.674578    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"]
Sep 11 13:07:34.680223 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:34.680198    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0e2299-openshift-default-64d674c76-857f5"]
Sep 11 13:07:36.141501 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:36.141469    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" path="/var/lib/kubelet/pods/d626bdbc-eb78-43d4-8290-ac8c95f4781e/volumes"
Sep 11 13:07:36.670809 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:36.670727    2572 generic.go:356] "Generic (PLEG): container finished" podID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerID="57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca" exitCode=0
Sep 11 13:07:36.670809 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:36.670765    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" event={"ID":"b038f81d-ded5-4d8a-b34f-0e1922618e7f","Type":"ContainerDied","Data":"57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca"}
Sep 11 13:07:36.671179 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:36.671163    2572 scope.go:117] "RemoveContainer" containerID="57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca"
Sep 11 13:07:36.672178 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:36.672150    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:07:36.672235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:36.672224    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:07:36.672272 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:36.672253    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:07:37.678336 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:37.678294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" event={"ID":"b038f81d-ded5-4d8a-b34f-0e1922618e7f","Type":"ContainerStarted","Data":"64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b"}
Sep 11 13:07:38.392562 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:38.392518    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:38.392787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:38.392681    2572 patch_prober.go:28] interesting pod/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:07:38.392787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:38.392726    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:07:39.392810 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:39.392297    2572 patch_prober.go:28] interesting pod/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:07:39.392810 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:39.392395    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:07:40.353441 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.353404    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"]
Sep 11 13:07:40.353703 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.353677    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2" podUID="d3a78206-8a17-47a8-b7b0-7a3b7ba09138" containerName="payload-pre-processing" containerID="cri-o://f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec" gracePeriod=30
Sep 11 13:07:40.402784 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.402745    2572 patch_prober.go:28] interesting pod/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:07:40.403406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.403369    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:07:40.639614 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.639590    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:07:40.712419 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.712080    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3a78206-8a17-47a8-b7b0-7a3b7ba09138" containerID="f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec" exitCode=0
Sep 11 13:07:40.712419 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.712157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2" event={"ID":"d3a78206-8a17-47a8-b7b0-7a3b7ba09138","Type":"ContainerDied","Data":"f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec"}
Sep 11 13:07:40.712419 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.712211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2" event={"ID":"d3a78206-8a17-47a8-b7b0-7a3b7ba09138","Type":"ContainerDied","Data":"0b9a84f9259aaaefeabb829a644703b2cdca72cdd935166aebb1d7ab272c5dfa"}
Sep 11 13:07:40.712419 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.712241    2572 scope.go:117] "RemoveContainer" containerID="f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec"
Sep 11 13:07:40.713462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.712891    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"
Sep 11 13:07:40.730834 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.730811    2572 scope.go:117] "RemoveContainer" containerID="f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec"
Sep 11 13:07:40.731338 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:07:40.731295    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec\": container with ID starting with f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec not found: ID does not exist" containerID="f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec"
Sep 11 13:07:40.731431 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.731349    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec"} err="failed to get container status \"f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec\": rpc error: code = NotFound desc = could not find container \"f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec\": container with ID starting with f48fb6f4135fcbfea42a9bcb7a72517a370b08cad9c1df38570166309fdd1dec not found: ID does not exist"
Sep 11 13:07:40.753712 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.753682    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-plugins-config-volume\") pod \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") "
Sep 11 13:07:40.753900 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.753780    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plv57\" (UniqueName: \"kubernetes.io/projected/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-kube-api-access-plv57\") pod \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\" (UID: \"d3a78206-8a17-47a8-b7b0-7a3b7ba09138\") "
Sep 11 13:07:40.754115 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.754083    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3a78206-8a17-47a8-b7b0-7a3b7ba09138" (UID: "d3a78206-8a17-47a8-b7b0-7a3b7ba09138"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:07:40.756019 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.755996    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-kube-api-access-plv57" (OuterVolumeSpecName: "kube-api-access-plv57") pod "d3a78206-8a17-47a8-b7b0-7a3b7ba09138" (UID: "d3a78206-8a17-47a8-b7b0-7a3b7ba09138"). InnerVolumeSpecName "kube-api-access-plv57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:40.855428 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.855387    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:40.855428 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:40.855419    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plv57\" (UniqueName: \"kubernetes.io/projected/d3a78206-8a17-47a8-b7b0-7a3b7ba09138-kube-api-access-plv57\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:41.040818 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:41.040783    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"]
Sep 11 13:07:41.043918 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:41.043886    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-de3842-68f6f76974-d9cm2"]
Sep 11 13:07:41.392955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:41.392389    2572 patch_prober.go:28] interesting pod/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:07:41.392955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:41.392467    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:07:42.140247 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:42.140215    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3a78206-8a17-47a8-b7b0-7a3b7ba09138" path="/var/lib/kubelet/pods/d3a78206-8a17-47a8-b7b0-7a3b7ba09138/volumes"
Sep 11 13:07:42.392379 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:42.392256    2572 patch_prober.go:28] interesting pod/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:07:42.392772 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:42.392737    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:07:43.396455 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:43.396425    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:43.396845 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:43.396801    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:43.397613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:43.397595    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:07:48.108736 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:48.108688    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"]
Sep 11 13:07:48.109164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:48.108909    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy" containerID="cri-o://3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852" gracePeriod=30
Sep 11 13:07:53.363349 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.363308    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:07:53.466003 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.465975    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istiod-ca-cert\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466023    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-socket\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466046    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-token\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466070    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-data\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466102    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-podinfo\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466122    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-credential-socket\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466152    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-certs\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466503 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466188    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnq7n\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-kube-api-access-bnq7n\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466503 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466234    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-envoy\") pod \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\" (UID: \"c432ec3a-4df6-4fb2-ad44-50a2e56af285\") "
Sep 11 13:07:53.466503 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466353    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:53.466647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466567    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:07:53.466647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466574    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.466779 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466759    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:53.466959 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466905    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:53.467118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.466953    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-data" (OuterVolumeSpecName: "istio-data") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:53.468923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.468896    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:07:53.469043 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.469007    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:07:53.469043 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.469035    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-token" (OuterVolumeSpecName: "istio-token") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:53.469150 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.469078    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-kube-api-access-bnq7n" (OuterVolumeSpecName: "kube-api-access-bnq7n") pod "c432ec3a-4df6-4fb2-ad44-50a2e56af285" (UID: "c432ec3a-4df6-4fb2-ad44-50a2e56af285"). InnerVolumeSpecName "kube-api-access-bnq7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:07:53.567465 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567427    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.567465 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567456    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.567465 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567465    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.567465 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567472    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.567730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567481    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c432ec3a-4df6-4fb2-ad44-50a2e56af285-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.567730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567488    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.567730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567497    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c432ec3a-4df6-4fb2-ad44-50a2e56af285-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.567730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.567506    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnq7n\" (UniqueName: \"kubernetes.io/projected/c432ec3a-4df6-4fb2-ad44-50a2e56af285-kube-api-access-bnq7n\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:07:53.778956 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.778868    2572 generic.go:356] "Generic (PLEG): container finished" podID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerID="3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852" exitCode=0
Sep 11 13:07:53.778956 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.778920    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"
Sep 11 13:07:53.779130 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.778956    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" event={"ID":"c432ec3a-4df6-4fb2-ad44-50a2e56af285","Type":"ContainerDied","Data":"3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852"}
Sep 11 13:07:53.779130 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.779010    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5" event={"ID":"c432ec3a-4df6-4fb2-ad44-50a2e56af285","Type":"ContainerDied","Data":"28f1a746bece002762f8336d2d06e3aa9384383e5f6aebad00debb030fc32c97"}
Sep 11 13:07:53.779130 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.779034    2572 scope.go:117] "RemoveContainer" containerID="3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852"
Sep 11 13:07:53.788572 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.788555    2572 scope.go:117] "RemoveContainer" containerID="44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4"
Sep 11 13:07:53.798288 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.798271    2572 scope.go:117] "RemoveContainer" containerID="3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852"
Sep 11 13:07:53.798644 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:07:53.798626    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852\": container with ID starting with 3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852 not found: ID does not exist" containerID="3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852"
Sep 11 13:07:53.798728 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.798655    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852"} err="failed to get container status \"3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852\": rpc error: code = NotFound desc = could not find container \"3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852\": container with ID starting with 3f464a0e49624f89585dbe018f153405995fa3f60c11ff96ff653b90523a9852 not found: ID does not exist"
Sep 11 13:07:53.798728 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.798679    2572 scope.go:117] "RemoveContainer" containerID="44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4"
Sep 11 13:07:53.798941 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:07:53.798926    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4\": container with ID starting with 44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4 not found: ID does not exist" containerID="44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4"
Sep 11 13:07:53.798992 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.798948    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4"} err="failed to get container status \"44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4\": rpc error: code = NotFound desc = could not find container \"44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4\": container with ID starting with 44526e306437a53b148b7ec277adc715a0fe7e9d9776962517883b435fc913d4 not found: ID does not exist"
Sep 11 13:07:53.825743 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.825715    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"]
Sep 11 13:07:53.840794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:53.840769    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-de3842-openshift-default-bdd494bdd-kpxj5"]
Sep 11 13:07:54.139760 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:07:54.139674    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" path="/var/lib/kubelet/pods/c432ec3a-4df6-4fb2-ad44-50a2e56af285/volumes"
Sep 11 13:08:03.748105 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:03.748069    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"]
Sep 11 13:08:03.748606 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:03.748373    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2" podUID="cebeb8ee-1d6c-4e41-8360-035c119ecbe8" containerName="payload-processing" containerID="cri-o://b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b" gracePeriod=30
Sep 11 13:08:03.761217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:03.761185    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"]
Sep 11 13:08:03.761468 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:03.761441    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd" podUID="1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" containerName="payload-pre-processing" containerID="cri-o://b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e" gracePeriod=30
Sep 11 13:08:04.032939 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.032905    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:08:04.035683 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.035664    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:08:04.065001 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.064968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-plugins-config-volume\") pod \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") "
Sep 11 13:08:04.065194 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.065061    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxhlj\" (UniqueName: \"kubernetes.io/projected/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-kube-api-access-hxhlj\") pod \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") "
Sep 11 13:08:04.065194 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.065083    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm8pd\" (UniqueName: \"kubernetes.io/projected/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-kube-api-access-hm8pd\") pod \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\" (UID: \"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9\") "
Sep 11 13:08:04.065194 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.065138    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-plugins-config-volume\") pod \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\" (UID: \"cebeb8ee-1d6c-4e41-8360-035c119ecbe8\") "
Sep 11 13:08:04.065537 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.065515    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" (UID: "1f176c0d-3cc8-45f2-a822-3bfb1bb088f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:08:04.065614 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.065532    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cebeb8ee-1d6c-4e41-8360-035c119ecbe8" (UID: "cebeb8ee-1d6c-4e41-8360-035c119ecbe8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:08:04.067573 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.067551    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-kube-api-access-hxhlj" (OuterVolumeSpecName: "kube-api-access-hxhlj") pod "cebeb8ee-1d6c-4e41-8360-035c119ecbe8" (UID: "cebeb8ee-1d6c-4e41-8360-035c119ecbe8"). InnerVolumeSpecName "kube-api-access-hxhlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:08:04.067692 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.067577    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-kube-api-access-hm8pd" (OuterVolumeSpecName: "kube-api-access-hm8pd") pod "1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" (UID: "1f176c0d-3cc8-45f2-a822-3bfb1bb088f9"). InnerVolumeSpecName "kube-api-access-hm8pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:08:04.166819 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.166789    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:04.166819 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.166816    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxhlj\" (UniqueName: \"kubernetes.io/projected/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-kube-api-access-hxhlj\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:04.167019 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.166833    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm8pd\" (UniqueName: \"kubernetes.io/projected/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9-kube-api-access-hm8pd\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:04.167019 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.166843    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb8ee-1d6c-4e41-8360-035c119ecbe8-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:04.838309 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.838273    2572 generic.go:356] "Generic (PLEG): container finished" podID="1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" containerID="b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e" exitCode=0
Sep 11 13:08:04.838830 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.838350    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"
Sep 11 13:08:04.838830 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.838372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd" event={"ID":"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9","Type":"ContainerDied","Data":"b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e"}
Sep 11 13:08:04.838830 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.838451    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd" event={"ID":"1f176c0d-3cc8-45f2-a822-3bfb1bb088f9","Type":"ContainerDied","Data":"af0b4a2b738a8aae33c8bb4a8a820a6052b0fd68e156c53a8956032ec4ffda94"}
Sep 11 13:08:04.838830 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.838487    2572 scope.go:117] "RemoveContainer" containerID="b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e"
Sep 11 13:08:04.839856 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.839782    2572 generic.go:356] "Generic (PLEG): container finished" podID="cebeb8ee-1d6c-4e41-8360-035c119ecbe8" containerID="b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b" exitCode=0
Sep 11 13:08:04.839856 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.839826    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"
Sep 11 13:08:04.839953 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.839870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2" event={"ID":"cebeb8ee-1d6c-4e41-8360-035c119ecbe8","Type":"ContainerDied","Data":"b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b"}
Sep 11 13:08:04.839953 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.839900    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2" event={"ID":"cebeb8ee-1d6c-4e41-8360-035c119ecbe8","Type":"ContainerDied","Data":"63aca6a81dca12afec2f8496f72c2f0ac9dacd19c2697a8f83ed17f37b323956"}
Sep 11 13:08:04.847221 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.847200    2572 scope.go:117] "RemoveContainer" containerID="b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e"
Sep 11 13:08:04.847623 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:08:04.847604    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e\": container with ID starting with b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e not found: ID does not exist" containerID="b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e"
Sep 11 13:08:04.847671 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.847631    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e"} err="failed to get container status \"b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e\": rpc error: code = NotFound desc = could not find container \"b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e\": container with ID starting with b75fc2cf2239b01e870f5057914f7d2c6ed165915c308cbb75c50e909c65f11e not found: ID does not exist"
Sep 11 13:08:04.847671 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.847648    2572 scope.go:117] "RemoveContainer" containerID="b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b"
Sep 11 13:08:04.855161 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.855144    2572 scope.go:117] "RemoveContainer" containerID="b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b"
Sep 11 13:08:04.855438 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:08:04.855417    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b\": container with ID starting with b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b not found: ID does not exist" containerID="b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b"
Sep 11 13:08:04.855511 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.855450    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b"} err="failed to get container status \"b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b\": rpc error: code = NotFound desc = could not find container \"b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b\": container with ID starting with b34934b39f29080be61ac94d8efc3a13c9e5d0e11d161afca168594d26b2019b not found: ID does not exist"
Sep 11 13:08:04.871667 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.871638    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"]
Sep 11 13:08:04.874698 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.874677    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f294ac01-f5969df54-szgpd"]
Sep 11 13:08:04.890402 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.890369    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"]
Sep 11 13:08:04.913009 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:04.912983    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f294ac01-99d8884bf-42zx2"]
Sep 11 13:08:06.139446 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:06.139415    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" path="/var/lib/kubelet/pods/1f176c0d-3cc8-45f2-a822-3bfb1bb088f9/volumes"
Sep 11 13:08:06.139822 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:06.139773    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cebeb8ee-1d6c-4e41-8360-035c119ecbe8" path="/var/lib/kubelet/pods/cebeb8ee-1d6c-4e41-8360-035c119ecbe8/volumes"
Sep 11 13:08:10.432550 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:10.432471    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"]
Sep 11 13:08:10.432944 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:10.432718    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy" containerID="cri-o://64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b" gracePeriod=30
Sep 11 13:08:13.399405 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:13.399364    2572 patch_prober.go:28] interesting pod/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:08:13.399883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:13.399426    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:08:15.688582 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.688556    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:08:15.782599 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782507    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-data\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782599 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782561    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-socket\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782599 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782595    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrhb4\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-kube-api-access-jrhb4\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782653    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istiod-ca-cert\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782684    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-certs\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782713    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-podinfo\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782756    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-token\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782779    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-credential-socket\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782795    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782862    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:08:15.782883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.782870    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-envoy\") pod \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\" (UID: \"b038f81d-ded5-4d8a-b34f-0e1922618e7f\") "
Sep 11 13:08:15.783253 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.783126    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:08:15.783253 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.783149    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:08:15.783253 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.783217    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:08:15.783390 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.783253    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.783390 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.783278    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.783390 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.783297    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.783390 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.783311    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.785170 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.785140    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:08:15.785258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.785202    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-kube-api-access-jrhb4" (OuterVolumeSpecName: "kube-api-access-jrhb4") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "kube-api-access-jrhb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:08:15.785539 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.785516    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:08:15.785633 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.785535    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b038f81d-ded5-4d8a-b34f-0e1922618e7f" (UID: "b038f81d-ded5-4d8a-b34f-0e1922618e7f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:08:15.883998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.883961    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.883998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.883990    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.883998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.883998    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.883998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.884007    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b038f81d-ded5-4d8a-b34f-0e1922618e7f-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.884273 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.884016    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrhb4\" (UniqueName: \"kubernetes.io/projected/b038f81d-ded5-4d8a-b34f-0e1922618e7f-kube-api-access-jrhb4\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:08:15.899779 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.899751    2572 generic.go:356] "Generic (PLEG): container finished" podID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerID="64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b" exitCode=0
Sep 11 13:08:15.899928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.899808    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"
Sep 11 13:08:15.899928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.899844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" event={"ID":"b038f81d-ded5-4d8a-b34f-0e1922618e7f","Type":"ContainerDied","Data":"64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b"}
Sep 11 13:08:15.899928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.899899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w" event={"ID":"b038f81d-ded5-4d8a-b34f-0e1922618e7f","Type":"ContainerDied","Data":"26bae42b6aa16d5ccda6dddd76dfce1c96c80c1072e41d18520a932a51e8fa20"}
Sep 11 13:08:15.899928 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.899928    2572 scope.go:117] "RemoveContainer" containerID="64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b"
Sep 11 13:08:15.914155 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.914129    2572 scope.go:117] "RemoveContainer" containerID="57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca"
Sep 11 13:08:15.922357 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.922307    2572 scope.go:117] "RemoveContainer" containerID="64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b"
Sep 11 13:08:15.922645 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:08:15.922625    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b\": container with ID starting with 64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b not found: ID does not exist" containerID="64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b"
Sep 11 13:08:15.922721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.922653    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b"} err="failed to get container status \"64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b\": rpc error: code = NotFound desc = could not find container \"64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b\": container with ID starting with 64d863235ca531c11328493955ffc20deb114d6afbea7319f486018671a4287b not found: ID does not exist"
Sep 11 13:08:15.922721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.922670    2572 scope.go:117] "RemoveContainer" containerID="57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca"
Sep 11 13:08:15.922905 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:08:15.922888    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca\": container with ID starting with 57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca not found: ID does not exist" containerID="57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca"
Sep 11 13:08:15.922945 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.922912    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca"} err="failed to get container status \"57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca\": rpc error: code = NotFound desc = could not find container \"57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca\": container with ID starting with 57c03f116eb1794cc249cd544a57916220523d90ae73554a40e353cad6b4bbca not found: ID does not exist"
Sep 11 13:08:15.937094 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.937064    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"]
Sep 11 13:08:15.946150 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:15.946125    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f294ac01-openshift-default-6fcb9d7476-2h67w"]
Sep 11 13:08:16.139342 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:16.139245    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" path="/var/lib/kubelet/pods/b038f81d-ded5-4d8a-b34f-0e1922618e7f/volumes"
Sep 11 13:08:18.309104 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309071    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"]
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309422    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309433    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309440    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309446    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309454    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309460    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309467    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" containerName="payload-pre-processing"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309472    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" containerName="payload-pre-processing"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309481    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309486    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309494    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309498    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309506    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309510    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309520    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cebeb8ee-1d6c-4e41-8360-035c119ecbe8" containerName="payload-processing"
Sep 11 13:08:18.309518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309526    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cebeb8ee-1d6c-4e41-8360-035c119ecbe8" containerName="payload-processing"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309533    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3a78206-8a17-47a8-b7b0-7a3b7ba09138" containerName="payload-pre-processing"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309539    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3a78206-8a17-47a8-b7b0-7a3b7ba09138" containerName="payload-pre-processing"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309605    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309612    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309619    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c432ec3a-4df6-4fb2-ad44-50a2e56af285" containerName="istio-proxy"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309625    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cebeb8ee-1d6c-4e41-8360-035c119ecbe8" containerName="payload-processing"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309632    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309638    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f176c0d-3cc8-45f2-a822-3bfb1bb088f9" containerName="payload-pre-processing"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309644    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b038f81d-ded5-4d8a-b34f-0e1922618e7f" containerName="istio-proxy"
Sep 11 13:08:18.310070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.309650    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3a78206-8a17-47a8-b7b0-7a3b7ba09138" containerName="payload-pre-processing"
Sep 11 13:08:18.314201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.314182    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.318671 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.318647    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-2e7f38-openshift-default-dockercfg-6kkmx\""
Sep 11 13:08:18.359606 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.359576    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"]
Sep 11 13:08:18.405874 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.405844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-podinfo\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406065 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.405883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-certs\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406065 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.405903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-socket\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406065 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.405926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istiod-ca-cert\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406065 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.405997    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-credential-socket\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406065 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.406036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-token\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406283 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.406084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-envoy\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406283 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.406107    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltd9\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-kube-api-access-8ltd9\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.406283 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.406135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-data\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507450 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507414    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-certs\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507450 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-socket\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istiod-ca-cert\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507495    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-credential-socket\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507511    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-token\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-envoy\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltd9\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-kube-api-access-8ltd9\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507618    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-data\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.507715 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-podinfo\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.508070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507859    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-certs\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.508070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-credential-socket\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.508070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.507923    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-socket\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.508237 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.508101    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-data\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.508360 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.508310    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istiod-ca-cert\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.510083 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.510065    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-envoy\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.510212 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.510195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-podinfo\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.527513 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.527482    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-token\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.529174 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.529151    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltd9\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-kube-api-access-8ltd9\") pod \"e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") " pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.624450 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.624353    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:18.925274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.925236    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"]
Sep 11 13:08:18.929244 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:08:18.929219    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6ae420_5c4a_4ea7_aaa7_6c9b51a8df3e.slice/crio-02473da1508169b12e64e8e96e31bef7abaeabe21f1a46ab4843b807e712f0e2 WatchSource:0}: Error finding container 02473da1508169b12e64e8e96e31bef7abaeabe21f1a46ab4843b807e712f0e2: Status 404 returned error can't find the container with id 02473da1508169b12e64e8e96e31bef7abaeabe21f1a46ab4843b807e712f0e2
Sep 11 13:08:18.931375 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.931345    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:18.931449 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.931409    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:18.931449 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:18.931442    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:19.921060 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:19.921020    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" event={"ID":"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e","Type":"ContainerStarted","Data":"072c799403ed9f67b23eb87e717950d8f9809de6a32f5fcd44525743d1b6fa36"}
Sep 11 13:08:19.921476 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:19.921109    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" event={"ID":"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e","Type":"ContainerStarted","Data":"02473da1508169b12e64e8e96e31bef7abaeabe21f1a46ab4843b807e712f0e2"}
Sep 11 13:08:20.625236 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:20.625194    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:20.630190 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:20.630159    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:20.666173 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:20.666113    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" podStartSLOduration=2.666095607 podStartE2EDuration="2.666095607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:19.982469981 +0000 UTC m=+1264.361995919" watchObservedRunningTime="2026-09-11 13:08:20.666095607 +0000 UTC m=+1265.045621542"
Sep 11 13:08:20.926485 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:20.926461    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:20.927429 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:20.927411    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:24.903729 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:24.903692    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"]
Sep 11 13:08:24.904202 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:24.904082    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d626bdbc-eb78-43d4-8290-ac8c95f4781e" containerName="istio-proxy"
Sep 11 13:08:24.907471 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:24.907454    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:24.911070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:24.911050    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-2e7f38-dockercfg-696lj\""
Sep 11 13:08:24.911238 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:24.911221    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-2e7f38\""
Sep 11 13:08:24.924422 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:24.924389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"]
Sep 11 13:08:25.064282 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.064246    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"]
Sep 11 13:08:25.067739 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.067721    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.068042 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.068018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aba9c03-ce22-4758-999b-5fa864f4f82e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.068147 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.068129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gns4r\" (UniqueName: \"kubernetes.io/projected/7aba9c03-ce22-4758-999b-5fa864f4f82e-kube-api-access-gns4r\") pod \"payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.109913 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.109882    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"]
Sep 11 13:08:25.169401 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.169298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gns4r\" (UniqueName: \"kubernetes.io/projected/7aba9c03-ce22-4758-999b-5fa864f4f82e-kube-api-access-gns4r\") pod \"payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.169401 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.169388    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdt2g\" (UniqueName: \"kubernetes.io/projected/a28589a6-aa59-4b09-9148-d80735228b01-kube-api-access-tdt2g\") pod \"payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.169610 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.169429    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a28589a6-aa59-4b09-9148-d80735228b01-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.169610 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.169459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aba9c03-ce22-4758-999b-5fa864f4f82e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.170079 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.170061    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aba9c03-ce22-4758-999b-5fa864f4f82e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.197553 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.197518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gns4r\" (UniqueName: \"kubernetes.io/projected/7aba9c03-ce22-4758-999b-5fa864f4f82e-kube-api-access-gns4r\") pod \"payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.218084 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.218046    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.270022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.269981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdt2g\" (UniqueName: \"kubernetes.io/projected/a28589a6-aa59-4b09-9148-d80735228b01-kube-api-access-tdt2g\") pod \"payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.270133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.270040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a28589a6-aa59-4b09-9148-d80735228b01-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.270891 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.270867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a28589a6-aa59-4b09-9148-d80735228b01-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.289864 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.289829    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdt2g\" (UniqueName: \"kubernetes.io/projected/a28589a6-aa59-4b09-9148-d80735228b01-kube-api-access-tdt2g\") pod \"payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.377057 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.377018    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.521090 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.521056    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"]
Sep 11 13:08:25.522211 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:08:25.522187    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aba9c03_ce22_4758_999b_5fa864f4f82e.slice/crio-16d5fd84f0d7a0a6dde07c5d7e94294e8c4c94909a9ef7f718cba327d52195fe WatchSource:0}: Error finding container 16d5fd84f0d7a0a6dde07c5d7e94294e8c4c94909a9ef7f718cba327d52195fe: Status 404 returned error can't find the container with id 16d5fd84f0d7a0a6dde07c5d7e94294e8c4c94909a9ef7f718cba327d52195fe
Sep 11 13:08:25.672300 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.672246    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"]
Sep 11 13:08:25.951563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.951453    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v" event={"ID":"a28589a6-aa59-4b09-9148-d80735228b01","Type":"ContainerStarted","Data":"e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a"}
Sep 11 13:08:25.951563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.951516    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:25.951563 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.951541    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v" event={"ID":"a28589a6-aa59-4b09-9148-d80735228b01","Type":"ContainerStarted","Data":"72ee5cfb2f6a79a15f51f8b2f98061a7d46eef25c4d0a321b7634431b7258301"}
Sep 11 13:08:25.953001 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.952978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822" event={"ID":"7aba9c03-ce22-4758-999b-5fa864f4f82e","Type":"ContainerStarted","Data":"70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79"}
Sep 11 13:08:25.953111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.953019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822" event={"ID":"7aba9c03-ce22-4758-999b-5fa864f4f82e","Type":"ContainerStarted","Data":"16d5fd84f0d7a0a6dde07c5d7e94294e8c4c94909a9ef7f718cba327d52195fe"}
Sep 11 13:08:25.953111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.953102    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:25.975851 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:25.975795    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v" podStartSLOduration=0.975777976 podStartE2EDuration="975.777976ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:25.973467933 +0000 UTC m=+1270.352993880" watchObservedRunningTime="2026-09-11 13:08:25.975777976 +0000 UTC m=+1270.355303912"
Sep 11 13:08:26.003051 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:26.002986    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822" podStartSLOduration=2.002966613 podStartE2EDuration="2.002966613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:26.002888475 +0000 UTC m=+1270.382414412" watchObservedRunningTime="2026-09-11 13:08:26.002966613 +0000 UTC m=+1270.382492549"
Sep 11 13:08:29.243237 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.243203    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"]
Sep 11 13:08:29.246783 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.246763    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.254283 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.254266    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-b81d9e-openshift-default-dockercfg-xsj9p\""
Sep 11 13:08:29.303302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.303268    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"]
Sep 11 13:08:29.307941 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.307913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768ef621-cad2-4398-a7ab-ec72f324529f-istiod-ca-cert\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.307946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-credential-socket\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.307974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9psnl\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-kube-api-access-9psnl\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.308030    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-certs\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.308072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-envoy\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.308095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768ef621-cad2-4398-a7ab-ec72f324529f-istio-podinfo\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.308119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-socket\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308526 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.308195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-data\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.308526 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.308262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-istio-token\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768ef621-cad2-4398-a7ab-ec72f324529f-istiod-ca-cert\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-credential-socket\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409268 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9psnl\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-kube-api-access-9psnl\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409268 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-certs\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409268 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409156    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-envoy\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409268 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768ef621-cad2-4398-a7ab-ec72f324529f-istio-podinfo\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409268 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-socket\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409551 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-data\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409551 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409378    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-istio-token\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409673 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409625    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-credential-socket\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409779 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-certs\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409830 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409813    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-socket\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.409873 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.409859    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-data\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.410146 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.410125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768ef621-cad2-4398-a7ab-ec72f324529f-istiod-ca-cert\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.411642 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.411622    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-envoy\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.411845 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.411828    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768ef621-cad2-4398-a7ab-ec72f324529f-istio-podinfo\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.429289 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.429258    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9psnl\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-kube-api-access-9psnl\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.435853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.435829    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-istio-token\") pod \"e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") " pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.558229 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.558115    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:29.865717 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.865631    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"]
Sep 11 13:08:29.871658 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:08:29.871632    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768ef621_cad2_4398_a7ab_ec72f324529f.slice/crio-9eb9fad7a109274dd5380708dc1e65a3287fdc806dab972d6689e4641e2e94dd WatchSource:0}: Error finding container 9eb9fad7a109274dd5380708dc1e65a3287fdc806dab972d6689e4641e2e94dd: Status 404 returned error can't find the container with id 9eb9fad7a109274dd5380708dc1e65a3287fdc806dab972d6689e4641e2e94dd
Sep 11 13:08:29.873922 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.873886    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:29.873997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.873966    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:29.874034 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.873994    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:29.981592 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.981556    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" event={"ID":"768ef621-cad2-4398-a7ab-ec72f324529f","Type":"ContainerStarted","Data":"b6caeb2a36224c43047f3f7497e824513142cc631a0d1af583298f4271c5835f"}
Sep 11 13:08:29.981768 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:29.981621    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" event={"ID":"768ef621-cad2-4398-a7ab-ec72f324529f","Type":"ContainerStarted","Data":"9eb9fad7a109274dd5380708dc1e65a3287fdc806dab972d6689e4641e2e94dd"}
Sep 11 13:08:30.559089 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:30.559052    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:30.564078 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:30.564051    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:30.597516 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:30.597452    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podStartSLOduration=1.597433928 podStartE2EDuration="1.597433928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:30.024738265 +0000 UTC m=+1274.404264200" watchObservedRunningTime="2026-09-11 13:08:30.597433928 +0000 UTC m=+1274.976959864"
Sep 11 13:08:30.988645 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:30.988607    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:30.993936 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:30.993898    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:34.204371 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.204304    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"]
Sep 11 13:08:34.209165 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.209130    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.211604 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.211566    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-b81d9e-dockercfg-w7qjn\""
Sep 11 13:08:34.211898 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.211870    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-b81d9e\""
Sep 11 13:08:34.218133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.218101    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"]
Sep 11 13:08:34.260506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.260452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82048c1a-1784-46de-b36d-55bc8bb8cf7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.260733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.260535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjsp\" (UniqueName: \"kubernetes.io/projected/82048c1a-1784-46de-b36d-55bc8bb8cf7c-kube-api-access-5jjsp\") pod \"payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.361676 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.361639    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjsp\" (UniqueName: \"kubernetes.io/projected/82048c1a-1784-46de-b36d-55bc8bb8cf7c-kube-api-access-5jjsp\") pod \"payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.361862 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.361735    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82048c1a-1784-46de-b36d-55bc8bb8cf7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.362397 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.362379    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82048c1a-1784-46de-b36d-55bc8bb8cf7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.392019 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.391979    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjsp\" (UniqueName: \"kubernetes.io/projected/82048c1a-1784-46de-b36d-55bc8bb8cf7c-kube-api-access-5jjsp\") pod \"payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.524374 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.524246    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:34.807018 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:34.805475    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"]
Sep 11 13:08:35.026706 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:35.026666    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9" event={"ID":"82048c1a-1784-46de-b36d-55bc8bb8cf7c","Type":"ContainerStarted","Data":"eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be"}
Sep 11 13:08:35.026892 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:35.026731    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9" event={"ID":"82048c1a-1784-46de-b36d-55bc8bb8cf7c","Type":"ContainerStarted","Data":"fcd2a7fb7163fc33570738dcca9d971255d0a238693b627a19649cfca7adaa5d"}
Sep 11 13:08:35.026892 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:35.026773    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:35.043763 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:35.043705    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9" podStartSLOduration=1.04368513 podStartE2EDuration="1.04368513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:35.043255364 +0000 UTC m=+1279.422781294" watchObservedRunningTime="2026-09-11 13:08:35.04368513 +0000 UTC m=+1279.423211067"
Sep 11 13:08:36.961546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:36.961507    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:08:36.962035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:36.961854    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:08:40.060004 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:40.059965    2572 generic.go:356] "Generic (PLEG): container finished" podID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerID="072c799403ed9f67b23eb87e717950d8f9809de6a32f5fcd44525743d1b6fa36" exitCode=0
Sep 11 13:08:40.060580 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:40.060033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" event={"ID":"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e","Type":"ContainerDied","Data":"072c799403ed9f67b23eb87e717950d8f9809de6a32f5fcd44525743d1b6fa36"}
Sep 11 13:08:40.060648 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:40.060609    2572 scope.go:117] "RemoveContainer" containerID="072c799403ed9f67b23eb87e717950d8f9809de6a32f5fcd44525743d1b6fa36"
Sep 11 13:08:40.061743 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:40.061707    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:40.061839 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:40.061781    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:40.061839 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:40.061812    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:41.067281 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:41.067251    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" event={"ID":"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e","Type":"ContainerStarted","Data":"cd20c29b4bc751d829b290695b1512faeccae76f55d3421a857879be6f7ea702"}
Sep 11 13:08:41.625222 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:41.625183    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:41.625626 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:41.625603    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:08:41.625796 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:41.625772    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 11 13:08:42.625113 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:42.625059    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:08:42.625679 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:42.625140    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 11 13:08:43.625339 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:43.625280    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:08:43.625990 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:43.625955    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 11 13:08:44.625948 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:44.625902    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:08:44.626515 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:44.625990    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 11 13:08:45.625506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:45.625464    2572 patch_prober.go:28] interesting pod/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:08:45.626294 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:45.625815    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 11 13:08:46.038258 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:46.038232    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:08:46.629106 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:46.629033    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:46.629486 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:46.629359    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:46.630057 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:46.630038    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:08:49.139087 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:49.139060    2572 generic.go:356] "Generic (PLEG): container finished" podID="768ef621-cad2-4398-a7ab-ec72f324529f" containerID="b6caeb2a36224c43047f3f7497e824513142cc631a0d1af583298f4271c5835f" exitCode=0
Sep 11 13:08:49.139535 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:49.139096    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" event={"ID":"768ef621-cad2-4398-a7ab-ec72f324529f","Type":"ContainerDied","Data":"b6caeb2a36224c43047f3f7497e824513142cc631a0d1af583298f4271c5835f"}
Sep 11 13:08:49.139535 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:49.139519    2572 scope.go:117] "RemoveContainer" containerID="b6caeb2a36224c43047f3f7497e824513142cc631a0d1af583298f4271c5835f"
Sep 11 13:08:49.140702 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:49.140670    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:49.140785 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:49.140750    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:49.140826 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:49.140784    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:08:49.150891 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:08:49.150860    2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768ef621_cad2_4398_a7ab_ec72f324529f.slice/crio-conmon-b6caeb2a36224c43047f3f7497e824513142cc631a0d1af583298f4271c5835f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768ef621_cad2_4398_a7ab_ec72f324529f.slice/crio-b6caeb2a36224c43047f3f7497e824513142cc631a0d1af583298f4271c5835f.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 13:08:50.145627 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:50.145592    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" event={"ID":"768ef621-cad2-4398-a7ab-ec72f324529f","Type":"ContainerStarted","Data":"226c73286969cbb3020996bdfcefe8e5d2d7a725f503f3e0d0175776904d6603"}
Sep 11 13:08:50.558650 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:50.558554    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:50.558951 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:50.558925    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:08:50.559047 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:50.558986    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 11 13:08:51.558977 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:51.558941    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:08:51.559395 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:51.559005    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 11 13:08:52.558880 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:52.558839    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:08:52.559082 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:52.558918    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 11 13:08:53.559077 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:53.559038    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:08:53.559543 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:53.559124    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 11 13:08:54.559062 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:54.559021    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:08:54.559628 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:54.559307    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 11 13:08:55.607575 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:55.607544    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:55.607980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:55.607835    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:08:55.608738 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:08:55.608720    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:09:03.059652 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.059616    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"]
Sep 11 13:09:03.064360 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.064312    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.066552 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.066531    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-7c542a-dockercfg-d9prc\""
Sep 11 13:09:03.067271 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.067238    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-7c542a\""
Sep 11 13:09:03.078611 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.078584    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"]
Sep 11 13:09:03.144540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.144507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjl6\" (UniqueName: \"kubernetes.io/projected/690a47b8-3ce0-494d-b729-29e3bc9f46a3-kube-api-access-wdjl6\") pod \"payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.144705 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.144579    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690a47b8-3ce0-494d-b729-29e3bc9f46a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.246142 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.246107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjl6\" (UniqueName: \"kubernetes.io/projected/690a47b8-3ce0-494d-b729-29e3bc9f46a3-kube-api-access-wdjl6\") pod \"payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.246374 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.246211    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690a47b8-3ce0-494d-b729-29e3bc9f46a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.252443 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.247894    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690a47b8-3ce0-494d-b729-29e3bc9f46a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.256077 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.256050    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjl6\" (UniqueName: \"kubernetes.io/projected/690a47b8-3ce0-494d-b729-29e3bc9f46a3-kube-api-access-wdjl6\") pod \"payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.374770 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.374677    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:03.660581 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:03.660553    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"]
Sep 11 13:09:03.662211 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:09:03.662183    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690a47b8_3ce0_494d_b729_29e3bc9f46a3.slice/crio-fca9074db85c4f959d7607dbe1de040cb824afbd96b226c0c68f97c9067ef734 WatchSource:0}: Error finding container fca9074db85c4f959d7607dbe1de040cb824afbd96b226c0c68f97c9067ef734: Status 404 returned error can't find the container with id fca9074db85c4f959d7607dbe1de040cb824afbd96b226c0c68f97c9067ef734
Sep 11 13:09:04.216872 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:04.216835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s" event={"ID":"690a47b8-3ce0-494d-b729-29e3bc9f46a3","Type":"ContainerStarted","Data":"99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da"}
Sep 11 13:09:04.217289 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:04.216899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s" event={"ID":"690a47b8-3ce0-494d-b729-29e3bc9f46a3","Type":"ContainerStarted","Data":"fca9074db85c4f959d7607dbe1de040cb824afbd96b226c0c68f97c9067ef734"}
Sep 11 13:09:04.217289 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:04.216987    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:04.236881 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:04.236824    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s" podStartSLOduration=1.2368075410000001 podStartE2EDuration="1.236807541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:04.234403029 +0000 UTC m=+1308.613928967" watchObservedRunningTime="2026-09-11 13:09:04.236807541 +0000 UTC m=+1308.616333519"
Sep 11 13:09:15.225230 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:15.225200    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:09:22.082459 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.082414    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"]
Sep 11 13:09:22.086207 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.086190    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.089171 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.089141    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"openshift-service-ca.crt\""
Sep 11 13:09:22.089340 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.089141    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"default-dockercfg-9rsc5\""
Sep 11 13:09:22.089340 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.089225    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"auth-test-model-d4b0b9-kserve-self-signed-certs\""
Sep 11 13:09:22.089340 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.089150    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"kube-root-ca.crt\""
Sep 11 13:09:22.099896 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.099871    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"]
Sep 11 13:09:22.100522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.100500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-dshm\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.100639 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.100542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-model-cache\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.100639 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.100563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f43b6f-2eb4-4912-8305-b149e90e760a-tls-certs\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.100721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.100671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-home\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.100721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.100696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6msrs\" (UniqueName: \"kubernetes.io/projected/d1f43b6f-2eb4-4912-8305-b149e90e760a-kube-api-access-6msrs\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.100721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.100714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-tmp-dir\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.201533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.201499    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-home\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.201533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.201535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6msrs\" (UniqueName: \"kubernetes.io/projected/d1f43b6f-2eb4-4912-8305-b149e90e760a-kube-api-access-6msrs\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.201776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.201554    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-tmp-dir\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.201776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.201629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-dshm\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.201776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.201663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-model-cache\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.201776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.201677    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f43b6f-2eb4-4912-8305-b149e90e760a-tls-certs\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.202032 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.202007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-tmp-dir\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.202032 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.202022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-home\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.202136 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.202070    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-model-cache\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.204114 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.204091    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-dshm\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.204389 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.204372    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f43b6f-2eb4-4912-8305-b149e90e760a-tls-certs\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.209098 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.209077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6msrs\" (UniqueName: \"kubernetes.io/projected/d1f43b6f-2eb4-4912-8305-b149e90e760a-kube-api-access-6msrs\") pod \"auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.395520 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.395490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:22.669166 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:22.669139    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"]
Sep 11 13:09:22.671397 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:09:22.671369    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1f43b6f_2eb4_4912_8305_b149e90e760a.slice/crio-1c77ecd4fbf20b5cbee8fe849ff6c8dedbb1b331cc47127100ca3776077d1d6d WatchSource:0}: Error finding container 1c77ecd4fbf20b5cbee8fe849ff6c8dedbb1b331cc47127100ca3776077d1d6d: Status 404 returned error can't find the container with id 1c77ecd4fbf20b5cbee8fe849ff6c8dedbb1b331cc47127100ca3776077d1d6d
Sep 11 13:09:23.317941 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:23.317909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6" event={"ID":"d1f43b6f-2eb4-4912-8305-b149e90e760a","Type":"ContainerStarted","Data":"6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d"}
Sep 11 13:09:23.318336 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:23.317949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6" event={"ID":"d1f43b6f-2eb4-4912-8305-b149e90e760a","Type":"ContainerStarted","Data":"1c77ecd4fbf20b5cbee8fe849ff6c8dedbb1b331cc47127100ca3776077d1d6d"}
Sep 11 13:09:23.333391 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:23.333345    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6" podStartSLOduration=1.333301203 podStartE2EDuration="1.333301203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:23.332717605 +0000 UTC m=+1327.712243541" watchObservedRunningTime="2026-09-11 13:09:23.333301203 +0000 UTC m=+1327.712827143"
Sep 11 13:09:31.035932 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.035895    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7794-8124ab"]
Sep 11 13:09:31.039330 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.039297    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:31.041489 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.041467    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-52h42\""
Sep 11 13:09:31.045988 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.045966    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-8124ab"]
Sep 11 13:09:31.074735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.074715    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmlgm\" (UniqueName: \"kubernetes.io/projected/f87163ab-ada8-4d76-81af-2d2bd52e3bc6-kube-api-access-hmlgm\") pod \"test-curl-7794-8124ab\" (UID: \"f87163ab-ada8-4d76-81af-2d2bd52e3bc6\") " pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:31.175762 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.175733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmlgm\" (UniqueName: \"kubernetes.io/projected/f87163ab-ada8-4d76-81af-2d2bd52e3bc6-kube-api-access-hmlgm\") pod \"test-curl-7794-8124ab\" (UID: \"f87163ab-ada8-4d76-81af-2d2bd52e3bc6\") " pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:31.185581 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.185553    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmlgm\" (UniqueName: \"kubernetes.io/projected/f87163ab-ada8-4d76-81af-2d2bd52e3bc6-kube-api-access-hmlgm\") pod \"test-curl-7794-8124ab\" (UID: \"f87163ab-ada8-4d76-81af-2d2bd52e3bc6\") " pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:31.350947 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.350871    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:31.633824 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:31.633799    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-8124ab"]
Sep 11 13:09:31.635018 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:09:31.634993    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf87163ab_ada8_4d76_81af_2d2bd52e3bc6.slice/crio-b712703a0663b359d87f8b2c98409f4f15aa1d0eae72cb955bd616364dda51ce WatchSource:0}: Error finding container b712703a0663b359d87f8b2c98409f4f15aa1d0eae72cb955bd616364dda51ce: Status 404 returned error can't find the container with id b712703a0663b359d87f8b2c98409f4f15aa1d0eae72cb955bd616364dda51ce
Sep 11 13:09:32.363500 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:32.363460    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-8124ab" event={"ID":"f87163ab-ada8-4d76-81af-2d2bd52e3bc6","Type":"ContainerStarted","Data":"60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361"}
Sep 11 13:09:32.363500 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:32.363505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-8124ab" event={"ID":"f87163ab-ada8-4d76-81af-2d2bd52e3bc6","Type":"ContainerStarted","Data":"b712703a0663b359d87f8b2c98409f4f15aa1d0eae72cb955bd616364dda51ce"}
Sep 11 13:09:32.395894 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:32.395861    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:32.395894 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:32.395903    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:32.408589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:32.408566    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:32.430940 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:32.430898    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7794-8124ab" podStartSLOduration=1.430884042 podStartE2EDuration="1.430884042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:32.385861665 +0000 UTC m=+1336.765387601" watchObservedRunningTime="2026-09-11 13:09:32.430884042 +0000 UTC m=+1336.810409977"
Sep 11 13:09:33.043051 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.043016    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7794-8124ab"]
Sep 11 13:09:33.048883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.048860    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7794-8124ab"]
Sep 11 13:09:33.193268 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.193237    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7794-a7482c"]
Sep 11 13:09:33.193671 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.193654    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" containerName="test-curl-7794-8124ab"
Sep 11 13:09:33.193718 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.193674    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" containerName="test-curl-7794-8124ab"
Sep 11 13:09:33.193754 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.193733    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" containerName="test-curl-7794-8124ab"
Sep 11 13:09:33.196875 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.196859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:33.204371 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.204347    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-a7482c"]
Sep 11 13:09:33.297681 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.297641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8rw\" (UniqueName: \"kubernetes.io/projected/914dde68-2360-471e-885d-0e9543abae9e-kube-api-access-6q8rw\") pod \"test-curl-7794-a7482c\" (UID: \"914dde68-2360-471e-885d-0e9543abae9e\") " pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:33.369028 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:09:33.369000    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7794-8124ab" container="test-curl-7794-8124ab"
Sep 11 13:09:33.380274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.380251    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:09:33.398950 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.398928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8rw\" (UniqueName: \"kubernetes.io/projected/914dde68-2360-471e-885d-0e9543abae9e-kube-api-access-6q8rw\") pod \"test-curl-7794-a7482c\" (UID: \"914dde68-2360-471e-885d-0e9543abae9e\") " pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:33.410708 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.410686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8rw\" (UniqueName: \"kubernetes.io/projected/914dde68-2360-471e-885d-0e9543abae9e-kube-api-access-6q8rw\") pod \"test-curl-7794-a7482c\" (UID: \"914dde68-2360-471e-885d-0e9543abae9e\") " pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:33.506057 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.505960    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:33.780979 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:33.780955    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7794-a7482c"]
Sep 11 13:09:33.782868 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:09:33.782836    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod914dde68_2360_471e_885d_0e9543abae9e.slice/crio-1465404b3f9e01d309c95450721c8d59e484f0b60352063ed4f87870edb57da2 WatchSource:0}: Error finding container 1465404b3f9e01d309c95450721c8d59e484f0b60352063ed4f87870edb57da2: Status 404 returned error can't find the container with id 1465404b3f9e01d309c95450721c8d59e484f0b60352063ed4f87870edb57da2
Sep 11 13:09:34.375042 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:34.375000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-a7482c" event={"ID":"914dde68-2360-471e-885d-0e9543abae9e","Type":"ContainerStarted","Data":"eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700"}
Sep 11 13:09:34.375042 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:34.375047    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7794-a7482c" event={"ID":"914dde68-2360-471e-885d-0e9543abae9e","Type":"ContainerStarted","Data":"1465404b3f9e01d309c95450721c8d59e484f0b60352063ed4f87870edb57da2"}
Sep 11 13:09:34.375904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:34.375042    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7794-8124ab" podUID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" containerName="test-curl-7794-8124ab" containerID="cri-o://60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361" gracePeriod=2
Sep 11 13:09:34.391301 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:34.391256    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7794-a7482c" podStartSLOduration=1.391240238 podStartE2EDuration="1.391240238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:34.389018099 +0000 UTC m=+1338.768544034" watchObservedRunningTime="2026-09-11 13:09:34.391240238 +0000 UTC m=+1338.770766188"
Sep 11 13:09:35.048862 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:35.048831    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7794-a7482c"]
Sep 11 13:09:35.051412 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:35.051383    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7794-a7482c"]
Sep 11 13:09:35.380468 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:09:35.380440    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7794-a7482c" container="test-curl-7794-a7482c"
Sep 11 13:09:36.384972 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:36.384934    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7794-a7482c" podUID="914dde68-2360-471e-885d-0e9543abae9e" containerName="test-curl-7794-a7482c" containerID="cri-o://eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700" gracePeriod=2
Sep 11 13:09:36.555511 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:36.555488    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:36.632114 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:36.632036    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmlgm\" (UniqueName: \"kubernetes.io/projected/f87163ab-ada8-4d76-81af-2d2bd52e3bc6-kube-api-access-hmlgm\") pod \"f87163ab-ada8-4d76-81af-2d2bd52e3bc6\" (UID: \"f87163ab-ada8-4d76-81af-2d2bd52e3bc6\") "
Sep 11 13:09:36.634256 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:36.634234    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87163ab-ada8-4d76-81af-2d2bd52e3bc6-kube-api-access-hmlgm" (OuterVolumeSpecName: "kube-api-access-hmlgm") pod "f87163ab-ada8-4d76-81af-2d2bd52e3bc6" (UID: "f87163ab-ada8-4d76-81af-2d2bd52e3bc6"). InnerVolumeSpecName "kube-api-access-hmlgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:36.733145 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:36.733106    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmlgm\" (UniqueName: \"kubernetes.io/projected/f87163ab-ada8-4d76-81af-2d2bd52e3bc6-kube-api-access-hmlgm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:09:37.391368 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.391312    2572 generic.go:356] "Generic (PLEG): container finished" podID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" containerID="60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361" exitCode=137
Sep 11 13:09:37.391368 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.391370    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:37.391896 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.391413    2572 scope.go:117] "RemoveContainer" containerID="60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361"
Sep 11 13:09:37.400112 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.400096    2572 scope.go:117] "RemoveContainer" containerID="60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361"
Sep 11 13:09:37.400378 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:09:37.400361    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361\": container with ID starting with 60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361 not found: ID does not exist" containerID="60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361"
Sep 11 13:09:37.400445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.400387    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361"} err="failed to get container status \"60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361\": rpc error: code = NotFound desc = could not find container \"60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361\": container with ID starting with 60f483f9d6b08a4a575bd81e80935e4033fbea8bc24bd500095516497366a361 not found: ID does not exist"
Sep 11 13:09:37.401538 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:09:37.401518    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-8124ab\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:37.886788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.886755    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"]
Sep 11 13:09:37.887138 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.887126    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914dde68-2360-471e-885d-0e9543abae9e" containerName="test-curl-7794-a7482c"
Sep 11 13:09:37.887138 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.887139    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="914dde68-2360-471e-885d-0e9543abae9e" containerName="test-curl-7794-a7482c"
Sep 11 13:09:37.887224 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.887203    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="914dde68-2360-471e-885d-0e9543abae9e" containerName="test-curl-7794-a7482c"
Sep 11 13:09:37.891352 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.891336    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.893779 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.893758    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f27fde90-openshift-default-dockercfg-v76sk\""
Sep 11 13:09:37.909002 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.908978    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"]
Sep 11 13:09:37.939541 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:09:37.939500    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-8124ab\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" pod="opendatahub/test-curl-7794-8124ab"
Sep 11 13:09:37.945019 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.944995    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-credential-socket\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945127 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ee0981-9349-4294-ae29-69a2843621d2-istio-podinfo\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945179 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945163    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ee0981-9349-4294-ae29-69a2843621d2-istiod-ca-cert\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945238 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-socket\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945259    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-certs\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945379 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-data\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945379 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktwrz\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-kube-api-access-ktwrz\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945492 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945403    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-istio-token\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:37.945492 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:37.945430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-envoy\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.046989 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.046899    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-socket\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.046989 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.046933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-certs\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.046989 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.046953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-data\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.046989 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.046969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwrz\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-kube-api-access-ktwrz\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047291 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.046993    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-istio-token\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047291 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047016    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-envoy\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047291 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047064    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-credential-socket\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047291 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ee0981-9349-4294-ae29-69a2843621d2-istio-podinfo\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047291 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047182    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ee0981-9349-4294-ae29-69a2843621d2-istiod-ca-cert\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047572 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047428    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-certs\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047572 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047448    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-data\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047572 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-credential-socket\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047736 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-socket\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.047899 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.047879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ee0981-9349-4294-ae29-69a2843621d2-istiod-ca-cert\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.049561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.049537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-envoy\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.050011 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.049993    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ee0981-9349-4294-ae29-69a2843621d2-istio-podinfo\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.056741 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.056716    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktwrz\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-kube-api-access-ktwrz\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.057036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.057012    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-istio-token\") pod \"e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") " pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.142602 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.142569    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f87163ab-ada8-4d76-81af-2d2bd52e3bc6" path="/var/lib/kubelet/pods/f87163ab-ada8-4d76-81af-2d2bd52e3bc6/volumes"
Sep 11 13:09:38.201158 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.201131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:38.481034 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.481002    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"]
Sep 11 13:09:38.483417 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:09:38.483387    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ee0981_9349_4294_ae29_69a2843621d2.slice/crio-cc345350d9619ae660d92a8b095c67f80cd0e34dd14f1d54abd6633c67bbd3ef WatchSource:0}: Error finding container cc345350d9619ae660d92a8b095c67f80cd0e34dd14f1d54abd6633c67bbd3ef: Status 404 returned error can't find the container with id cc345350d9619ae660d92a8b095c67f80cd0e34dd14f1d54abd6633c67bbd3ef
Sep 11 13:09:38.485593 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.485558    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:09:38.485670 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.485625    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:09:38.485670 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.485654    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:09:38.558719 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.558699    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:38.655226 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.655189    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q8rw\" (UniqueName: \"kubernetes.io/projected/914dde68-2360-471e-885d-0e9543abae9e-kube-api-access-6q8rw\") pod \"914dde68-2360-471e-885d-0e9543abae9e\" (UID: \"914dde68-2360-471e-885d-0e9543abae9e\") "
Sep 11 13:09:38.657926 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.657888    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914dde68-2360-471e-885d-0e9543abae9e-kube-api-access-6q8rw" (OuterVolumeSpecName: "kube-api-access-6q8rw") pod "914dde68-2360-471e-885d-0e9543abae9e" (UID: "914dde68-2360-471e-885d-0e9543abae9e"). InnerVolumeSpecName "kube-api-access-6q8rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:38.756313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:38.756280    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q8rw\" (UniqueName: \"kubernetes.io/projected/914dde68-2360-471e-885d-0e9543abae9e-kube-api-access-6q8rw\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:09:39.403745 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.403709    2572 generic.go:356] "Generic (PLEG): container finished" podID="914dde68-2360-471e-885d-0e9543abae9e" containerID="eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700" exitCode=137
Sep 11 13:09:39.403953 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.403759    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:39.403953 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.403815    2572 scope.go:117] "RemoveContainer" containerID="eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700"
Sep 11 13:09:39.405635 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.405610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" event={"ID":"94ee0981-9349-4294-ae29-69a2843621d2","Type":"ContainerStarted","Data":"49c4f71a5ceaa3cdceffce0c024cc6e9644527b60c35102b508254cf78962042"}
Sep 11 13:09:39.405751 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.405695    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" event={"ID":"94ee0981-9349-4294-ae29-69a2843621d2","Type":"ContainerStarted","Data":"cc345350d9619ae660d92a8b095c67f80cd0e34dd14f1d54abd6633c67bbd3ef"}
Sep 11 13:09:39.413087 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.413070    2572 scope.go:117] "RemoveContainer" containerID="eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700"
Sep 11 13:09:39.413344 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:09:39.413312    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700\": container with ID starting with eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700 not found: ID does not exist" containerID="eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700"
Sep 11 13:09:39.413388 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.413352    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700"} err="failed to get container status \"eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700\": rpc error: code = NotFound desc = could not find container \"eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700\": container with ID starting with eb6d86bdc4e457ac6e8ee47be9fa807166241a055f72eee9264461c6b6851700 not found: ID does not exist"
Sep 11 13:09:39.427774 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:09:39.427740    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7794-a7482c\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="914dde68-2360-471e-885d-0e9543abae9e" pod="opendatahub/test-curl-7794-a7482c"
Sep 11 13:09:39.428058 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:39.428027    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podStartSLOduration=2.428016546 podStartE2EDuration="2.428016546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:39.425954605 +0000 UTC m=+1343.805480567" watchObservedRunningTime="2026-09-11 13:09:39.428016546 +0000 UTC m=+1343.807542482"
Sep 11 13:09:40.140193 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:40.140161    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="914dde68-2360-471e-885d-0e9543abae9e" path="/var/lib/kubelet/pods/914dde68-2360-471e-885d-0e9543abae9e/volumes"
Sep 11 13:09:40.201503 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:40.201472    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:40.207168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:40.207144    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:40.411977 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:40.411946    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:40.412923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:40.412906    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:09:43.428164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.428133    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"]
Sep 11 13:09:43.433138 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.433122    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:43.435845 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.435826    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f27fde90-dockercfg-9t9gf\""
Sep 11 13:09:43.436024 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.436006    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f27fde90\""
Sep 11 13:09:43.449887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.449861    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"]
Sep 11 13:09:43.500251 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.500210    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57ee0752-a693-4170-9fac-051d36398c5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:43.500427 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.500395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpqpw\" (UniqueName: \"kubernetes.io/projected/57ee0752-a693-4170-9fac-051d36398c5b-kube-api-access-cpqpw\") pod \"payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:43.600955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.600913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57ee0752-a693-4170-9fac-051d36398c5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:43.601156 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.601003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpqpw\" (UniqueName: \"kubernetes.io/projected/57ee0752-a693-4170-9fac-051d36398c5b-kube-api-access-cpqpw\") pod \"payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:43.601732 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.601707    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57ee0752-a693-4170-9fac-051d36398c5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:43.612098 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.612077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpqpw\" (UniqueName: \"kubernetes.io/projected/57ee0752-a693-4170-9fac-051d36398c5b-kube-api-access-cpqpw\") pod \"payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:43.743172 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:43.743085    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:44.048970 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:44.048874    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"]
Sep 11 13:09:44.056167 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:09:44.056139    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ee0752_a693_4170_9fac_051d36398c5b.slice/crio-50317ce475c0de270ff302d69a901020c401f68b6bf5ff041d67e0facd6c8c52 WatchSource:0}: Error finding container 50317ce475c0de270ff302d69a901020c401f68b6bf5ff041d67e0facd6c8c52: Status 404 returned error can't find the container with id 50317ce475c0de270ff302d69a901020c401f68b6bf5ff041d67e0facd6c8c52
Sep 11 13:09:44.435522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:44.435491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld" event={"ID":"57ee0752-a693-4170-9fac-051d36398c5b","Type":"ContainerStarted","Data":"46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be"}
Sep 11 13:09:44.435889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:44.435538    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld" event={"ID":"57ee0752-a693-4170-9fac-051d36398c5b","Type":"ContainerStarted","Data":"50317ce475c0de270ff302d69a901020c401f68b6bf5ff041d67e0facd6c8c52"}
Sep 11 13:09:44.435889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:44.435619    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:09:44.457276 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:44.457216    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld" podStartSLOduration=1.457197064 podStartE2EDuration="1.457197064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:44.454357113 +0000 UTC m=+1348.833883050" watchObservedRunningTime="2026-09-11 13:09:44.457197064 +0000 UTC m=+1348.836723009"
Sep 11 13:09:55.443389 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:09:55.443349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:10:02.549712 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:02.549621    2572 generic.go:356] "Generic (PLEG): container finished" podID="94ee0981-9349-4294-ae29-69a2843621d2" containerID="49c4f71a5ceaa3cdceffce0c024cc6e9644527b60c35102b508254cf78962042" exitCode=0
Sep 11 13:10:02.549712 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:02.549690    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" event={"ID":"94ee0981-9349-4294-ae29-69a2843621d2","Type":"ContainerDied","Data":"49c4f71a5ceaa3cdceffce0c024cc6e9644527b60c35102b508254cf78962042"}
Sep 11 13:10:02.550169 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:02.550151    2572 scope.go:117] "RemoveContainer" containerID="49c4f71a5ceaa3cdceffce0c024cc6e9644527b60c35102b508254cf78962042"
Sep 11 13:10:02.551455 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:02.551424    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:10:02.551520 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:02.551493    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:10:02.551556 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:02.551528    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:10:03.557547 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:03.557510    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" event={"ID":"94ee0981-9349-4294-ae29-69a2843621d2","Type":"ContainerStarted","Data":"8393e97b83054cd459bf05b1f09c27f8dc622514c407c5d5a72e87d70ec66267"}
Sep 11 13:10:04.201828 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:04.201791    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:10:04.202182 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:04.202161    2572 patch_prober.go:28] interesting pod/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:10:04.202437 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:04.202400    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:10:05.202445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:05.202396    2572 patch_prober.go:28] interesting pod/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:10:05.202961 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:05.202475    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:10:06.201922 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:06.201882    2572 patch_prober.go:28] interesting pod/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:10:06.202215 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:06.202187    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:10:07.202300 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:07.202256    2572 patch_prober.go:28] interesting pod/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:10:07.202837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:07.202350    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:10:08.205775 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:08.205737    2572 patch_prober.go:28] interesting pod/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:10:08.206285 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:08.205807    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:10:09.397654 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:09.397616    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:10:09.398153 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:09.397910    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:10:09.399109 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:09.399091    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:10:16.265166 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:16.265137    2572 scope.go:117] "RemoveContainer" containerID="38a229c6ee79212c79805bb2a2b0f94d1c3f95d0ba5d2fb439ca81b3564014f8"
Sep 11 13:10:16.273501 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:16.273481    2572 scope.go:117] "RemoveContainer" containerID="55e87d658374df553537032de6443cbd0bdf575aa02222d274262d37fafd350c"
Sep 11 13:10:19.412869 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.412838    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"]
Sep 11 13:10:19.416143 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.416111    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.419378 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.419356    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f27fde90\"/\"default-dockercfg-qptzr\""
Sep 11 13:10:19.419521 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.419380    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f27fde90\"/\"kube-root-ca.crt\""
Sep 11 13:10:19.419521 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.419384    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f27fde90\"/\"openshift-service-ca.crt\""
Sep 11 13:10:19.419521 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.419413    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f27fde90\"/\"e2e-lifecycle-model-f27fde90-kserve-self-signed-certs\""
Sep 11 13:10:19.426505 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.426481    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"]
Sep 11 13:10:19.454722 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.454695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-tmp-dir\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.454823 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.454731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-model-cache\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.454823 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.454756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-dshm\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.454823 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.454775    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0303e596-9832-41cd-ae11-2ec0670c838b-tls-certs\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.454938 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.454838    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9j27\" (UniqueName: \"kubernetes.io/projected/0303e596-9832-41cd-ae11-2ec0670c838b-kube-api-access-z9j27\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.454938 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.454858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-home\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.555825 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.555796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9j27\" (UniqueName: \"kubernetes.io/projected/0303e596-9832-41cd-ae11-2ec0670c838b-kube-api-access-z9j27\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.555983 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.555835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-home\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.555983 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.555920    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-tmp-dir\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.555983 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.555946    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-model-cache\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.555983 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.555980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-dshm\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.556204 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.556008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0303e596-9832-41cd-ae11-2ec0670c838b-tls-certs\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.556359 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.556302    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-home\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.556359 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.556348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-model-cache\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.556468 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.556397    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-tmp-dir\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.558296 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.558279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-dshm\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.558590 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.558572    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0303e596-9832-41cd-ae11-2ec0670c838b-tls-certs\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.564096 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.564073    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9j27\" (UniqueName: \"kubernetes.io/projected/0303e596-9832-41cd-ae11-2ec0670c838b-kube-api-access-z9j27\") pod \"e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") " pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.728768 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.728671    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:19.999218 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:19.999132    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"]
Sep 11 13:10:20.001427 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:10:20.001397    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0303e596_9832_41cd_ae11_2ec0670c838b.slice/crio-9ccc4c82a50db3979895ab4682a4a304daa41c25207a9294dab65f9403f3debf WatchSource:0}: Error finding container 9ccc4c82a50db3979895ab4682a4a304daa41c25207a9294dab65f9403f3debf: Status 404 returned error can't find the container with id 9ccc4c82a50db3979895ab4682a4a304daa41c25207a9294dab65f9403f3debf
Sep 11 13:10:20.646487 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:20.646444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj" event={"ID":"0303e596-9832-41cd-ae11-2ec0670c838b","Type":"ContainerStarted","Data":"b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada"}
Sep 11 13:10:20.646487 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:20.646486    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj" event={"ID":"0303e596-9832-41cd-ae11-2ec0670c838b","Type":"ContainerStarted","Data":"9ccc4c82a50db3979895ab4682a4a304daa41c25207a9294dab65f9403f3debf"}
Sep 11 13:10:20.663015 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:20.662967    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj" podStartSLOduration=1.662951723 podStartE2EDuration="1.662951723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:10:20.662578034 +0000 UTC m=+1385.042103967" watchObservedRunningTime="2026-09-11 13:10:20.662951723 +0000 UTC m=+1385.042477659"
Sep 11 13:10:29.729027 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:29.728988    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:29.729488 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:29.729038    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:29.741904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:29.741881    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:30.708912 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:30.708881    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:10:46.178629 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.178595    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"]
Sep 11 13:10:46.180923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.180906    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"
Sep 11 13:10:46.183155 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.183133    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:10:46.183271 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.183164    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:10:46.190638 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.190614    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"]
Sep 11 13:10:46.217074 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.217046    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c172959-6a8f-49b9-8aa9-e22eee33b4ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv\" (UID: \"4c172959-6a8f-49b9-8aa9-e22eee33b4ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"
Sep 11 13:10:46.318145 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.318112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c172959-6a8f-49b9-8aa9-e22eee33b4ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv\" (UID: \"4c172959-6a8f-49b9-8aa9-e22eee33b4ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"
Sep 11 13:10:46.318780 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.318761    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c172959-6a8f-49b9-8aa9-e22eee33b4ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv\" (UID: \"4c172959-6a8f-49b9-8aa9-e22eee33b4ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"
Sep 11 13:10:46.492817 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.492744    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"
Sep 11 13:10:46.768109 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.768021    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"]
Sep 11 13:10:46.770865 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:10:46.770837    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c172959_6a8f_49b9_8aa9_e22eee33b4ee.slice/crio-49fe17cd60068a433cbe311354c2ce6fdf9728a70c19deca80af86893bdab2aa WatchSource:0}: Error finding container 49fe17cd60068a433cbe311354c2ce6fdf9728a70c19deca80af86893bdab2aa: Status 404 returned error can't find the container with id 49fe17cd60068a433cbe311354c2ce6fdf9728a70c19deca80af86893bdab2aa
Sep 11 13:10:46.787712 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:46.787688    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv" event={"ID":"4c172959-6a8f-49b9-8aa9-e22eee33b4ee","Type":"ContainerStarted","Data":"49fe17cd60068a433cbe311354c2ce6fdf9728a70c19deca80af86893bdab2aa"}
Sep 11 13:10:47.794523 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:47.794435    2572 generic.go:356] "Generic (PLEG): container finished" podID="4c172959-6a8f-49b9-8aa9-e22eee33b4ee" containerID="69c31b8177eef2ae6786a3a224bcdd92deae6b078019d40229578544cdd1be46" exitCode=0
Sep 11 13:10:47.794884 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:47.794526    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv" event={"ID":"4c172959-6a8f-49b9-8aa9-e22eee33b4ee","Type":"ContainerDied","Data":"69c31b8177eef2ae6786a3a224bcdd92deae6b078019d40229578544cdd1be46"}
Sep 11 13:10:48.930921 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:48.930901    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"
Sep 11 13:10:48.942469 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:48.942449    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c172959-6a8f-49b9-8aa9-e22eee33b4ee-maas-api-service-ca\") pod \"4c172959-6a8f-49b9-8aa9-e22eee33b4ee\" (UID: \"4c172959-6a8f-49b9-8aa9-e22eee33b4ee\") "
Sep 11 13:10:48.942744 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:48.942725    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c172959-6a8f-49b9-8aa9-e22eee33b4ee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c172959-6a8f-49b9-8aa9-e22eee33b4ee" (UID: "4c172959-6a8f-49b9-8aa9-e22eee33b4ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:49.043580 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:49.043547    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c172959-6a8f-49b9-8aa9-e22eee33b4ee-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:10:49.805457 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:49.805429    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"
Sep 11 13:10:49.805645 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:49.805432    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv" event={"ID":"4c172959-6a8f-49b9-8aa9-e22eee33b4ee","Type":"ContainerDied","Data":"49fe17cd60068a433cbe311354c2ce6fdf9728a70c19deca80af86893bdab2aa"}
Sep 11 13:10:49.805645 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:10:49.805539    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49fe17cd60068a433cbe311354c2ce6fdf9728a70c19deca80af86893bdab2aa"
Sep 11 13:11:01.807902 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:01.807867    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"]
Sep 11 13:11:01.808434 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:01.808135    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld" podUID="57ee0752-a693-4170-9fac-051d36398c5b" containerName="payload-pre-processing" containerID="cri-o://46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be" gracePeriod=30
Sep 11 13:11:02.010476 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.010440    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"]
Sep 11 13:11:02.024132 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.019808    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f27fde90-xgfcv"]
Sep 11 13:11:02.060496 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.060431    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:11:02.141956 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.141925    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c172959-6a8f-49b9-8aa9-e22eee33b4ee" path="/var/lib/kubelet/pods/4c172959-6a8f-49b9-8aa9-e22eee33b4ee/volumes"
Sep 11 13:11:02.171233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.171201    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpqpw\" (UniqueName: \"kubernetes.io/projected/57ee0752-a693-4170-9fac-051d36398c5b-kube-api-access-cpqpw\") pod \"57ee0752-a693-4170-9fac-051d36398c5b\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") "
Sep 11 13:11:02.171416 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.171297    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57ee0752-a693-4170-9fac-051d36398c5b-plugins-config-volume\") pod \"57ee0752-a693-4170-9fac-051d36398c5b\" (UID: \"57ee0752-a693-4170-9fac-051d36398c5b\") "
Sep 11 13:11:02.171750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.171723    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ee0752-a693-4170-9fac-051d36398c5b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57ee0752-a693-4170-9fac-051d36398c5b" (UID: "57ee0752-a693-4170-9fac-051d36398c5b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:02.173491 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.173464    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ee0752-a693-4170-9fac-051d36398c5b-kube-api-access-cpqpw" (OuterVolumeSpecName: "kube-api-access-cpqpw") pod "57ee0752-a693-4170-9fac-051d36398c5b" (UID: "57ee0752-a693-4170-9fac-051d36398c5b"). InnerVolumeSpecName "kube-api-access-cpqpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:02.272694 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.272651    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpqpw\" (UniqueName: \"kubernetes.io/projected/57ee0752-a693-4170-9fac-051d36398c5b-kube-api-access-cpqpw\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:02.272694 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.272682    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57ee0752-a693-4170-9fac-051d36398c5b-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:02.881925 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.881885    2572 generic.go:356] "Generic (PLEG): container finished" podID="57ee0752-a693-4170-9fac-051d36398c5b" containerID="46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be" exitCode=0
Sep 11 13:11:02.882434 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.881938    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"
Sep 11 13:11:02.882434 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.881982    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld" event={"ID":"57ee0752-a693-4170-9fac-051d36398c5b","Type":"ContainerDied","Data":"46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be"}
Sep 11 13:11:02.882434 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.882046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld" event={"ID":"57ee0752-a693-4170-9fac-051d36398c5b","Type":"ContainerDied","Data":"50317ce475c0de270ff302d69a901020c401f68b6bf5ff041d67e0facd6c8c52"}
Sep 11 13:11:02.882434 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.882072    2572 scope.go:117] "RemoveContainer" containerID="46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be"
Sep 11 13:11:02.891750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.891729    2572 scope.go:117] "RemoveContainer" containerID="46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be"
Sep 11 13:11:02.892061 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:11:02.892041    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be\": container with ID starting with 46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be not found: ID does not exist" containerID="46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be"
Sep 11 13:11:02.892131 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.892075    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be"} err="failed to get container status \"46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be\": rpc error: code = NotFound desc = could not find container \"46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be\": container with ID starting with 46d2e71cff5e61458e5e6068378f848b5e1bdab46a08421eb1e1d8bbea07e7be not found: ID does not exist"
Sep 11 13:11:02.903586 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.903563    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"]
Sep 11 13:11:02.913661 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:02.913636    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f27fde90-564d8686fd-zcmld"]
Sep 11 13:11:04.140633 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:04.140601    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ee0752-a693-4170-9fac-051d36398c5b" path="/var/lib/kubelet/pods/57ee0752-a693-4170-9fac-051d36398c5b/volumes"
Sep 11 13:11:10.316208 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:10.316128    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"]
Sep 11 13:11:16.303177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:16.303143    2572 scope.go:117] "RemoveContainer" containerID="98bf3c0930db95357a6a5348f1bd4876b369536ca866074de8df0969cdb2f7d0"
Sep 11 13:11:16.311802 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:16.311777    2572 scope.go:117] "RemoveContainer" containerID="a7e27104b8810ac66bfd41981c8e3ecf8f9eead3d2d1a5f2f338fb87bd0cb18e"
Sep 11 13:11:25.336240 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.336185    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj" podUID="0303e596-9832-41cd-ae11-2ec0670c838b" containerName="main" containerID="cri-o://b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada" gracePeriod=45
Sep 11 13:11:25.593445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.593386    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:11:25.602332 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602299    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9j27\" (UniqueName: \"kubernetes.io/projected/0303e596-9832-41cd-ae11-2ec0670c838b-kube-api-access-z9j27\") pod \"0303e596-9832-41cd-ae11-2ec0670c838b\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") "
Sep 11 13:11:25.602440 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602363    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-tmp-dir\") pod \"0303e596-9832-41cd-ae11-2ec0670c838b\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") "
Sep 11 13:11:25.602440 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602385    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-model-cache\") pod \"0303e596-9832-41cd-ae11-2ec0670c838b\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") "
Sep 11 13:11:25.602440 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602406    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-dshm\") pod \"0303e596-9832-41cd-ae11-2ec0670c838b\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") "
Sep 11 13:11:25.602603 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602457    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-home\") pod \"0303e596-9832-41cd-ae11-2ec0670c838b\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") "
Sep 11 13:11:25.602603 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602483    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0303e596-9832-41cd-ae11-2ec0670c838b-tls-certs\") pod \"0303e596-9832-41cd-ae11-2ec0670c838b\" (UID: \"0303e596-9832-41cd-ae11-2ec0670c838b\") "
Sep 11 13:11:25.602708 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602686    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0303e596-9832-41cd-ae11-2ec0670c838b" (UID: "0303e596-9832-41cd-ae11-2ec0670c838b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:25.602766 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602698    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-model-cache" (OuterVolumeSpecName: "model-cache") pod "0303e596-9832-41cd-ae11-2ec0670c838b" (UID: "0303e596-9832-41cd-ae11-2ec0670c838b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:25.602766 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602734    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-home" (OuterVolumeSpecName: "home") pod "0303e596-9832-41cd-ae11-2ec0670c838b" (UID: "0303e596-9832-41cd-ae11-2ec0670c838b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:25.602883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602865    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-home\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:25.602926 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602891    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-tmp-dir\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:25.602926 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.602906    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-model-cache\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:25.604654 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.604633    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0303e596-9832-41cd-ae11-2ec0670c838b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0303e596-9832-41cd-ae11-2ec0670c838b" (UID: "0303e596-9832-41cd-ae11-2ec0670c838b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:11:25.604751 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.604732    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0303e596-9832-41cd-ae11-2ec0670c838b-kube-api-access-z9j27" (OuterVolumeSpecName: "kube-api-access-z9j27") pod "0303e596-9832-41cd-ae11-2ec0670c838b" (UID: "0303e596-9832-41cd-ae11-2ec0670c838b"). InnerVolumeSpecName "kube-api-access-z9j27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:25.604751 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.604736    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-dshm" (OuterVolumeSpecName: "dshm") pod "0303e596-9832-41cd-ae11-2ec0670c838b" (UID: "0303e596-9832-41cd-ae11-2ec0670c838b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:25.704409 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.704377    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9j27\" (UniqueName: \"kubernetes.io/projected/0303e596-9832-41cd-ae11-2ec0670c838b-kube-api-access-z9j27\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:25.704409 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.704404    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0303e596-9832-41cd-ae11-2ec0670c838b-dshm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:25.704409 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:25.704416    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0303e596-9832-41cd-ae11-2ec0670c838b-tls-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:26.000737 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.000700    2572 generic.go:356] "Generic (PLEG): container finished" podID="0303e596-9832-41cd-ae11-2ec0670c838b" containerID="b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada" exitCode=0
Sep 11 13:11:26.000934 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.000751    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"
Sep 11 13:11:26.000934 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.000757    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj" event={"ID":"0303e596-9832-41cd-ae11-2ec0670c838b","Type":"ContainerDied","Data":"b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada"}
Sep 11 13:11:26.000934 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.000797    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj" event={"ID":"0303e596-9832-41cd-ae11-2ec0670c838b","Type":"ContainerDied","Data":"9ccc4c82a50db3979895ab4682a4a304daa41c25207a9294dab65f9403f3debf"}
Sep 11 13:11:26.000934 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.000820    2572 scope.go:117] "RemoveContainer" containerID="b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada"
Sep 11 13:11:26.009930 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.009911    2572 scope.go:117] "RemoveContainer" containerID="b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada"
Sep 11 13:11:26.010237 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:11:26.010217    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada\": container with ID starting with b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada not found: ID does not exist" containerID="b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada"
Sep 11 13:11:26.010285 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.010247    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada"} err="failed to get container status \"b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada\": rpc error: code = NotFound desc = could not find container \"b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada\": container with ID starting with b9ed0c03f6edd58b78d0b72a55726a9c0e130b97a1f2437bce2fa0f256545ada not found: ID does not exist"
Sep 11 13:11:26.021839 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.021814    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"]
Sep 11 13:11:26.024143 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.024119    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f27fde90/e2e-lifecycle-model-f27fde90-kserve-64f557d479-c86lj"]
Sep 11 13:11:26.140647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:26.140619    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0303e596-9832-41cd-ae11-2ec0670c838b" path="/var/lib/kubelet/pods/0303e596-9832-41cd-ae11-2ec0670c838b/volumes"
Sep 11 13:11:54.053339 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:54.053278    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"]
Sep 11 13:11:54.053819 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:54.053566    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy" containerID="cri-o://8393e97b83054cd459bf05b1f09c27f8dc622514c407c5d5a72e87d70ec66267" gracePeriod=30
Sep 11 13:11:54.400261 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:54.400220    2572 patch_prober.go:28] interesting pod/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:11:54.400456 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:54.400277    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:11:59.169588 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.169558    2572 generic.go:356] "Generic (PLEG): container finished" podID="94ee0981-9349-4294-ae29-69a2843621d2" containerID="8393e97b83054cd459bf05b1f09c27f8dc622514c407c5d5a72e87d70ec66267" exitCode=0
Sep 11 13:11:59.169920 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.169607    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" event={"ID":"94ee0981-9349-4294-ae29-69a2843621d2","Type":"ContainerDied","Data":"8393e97b83054cd459bf05b1f09c27f8dc622514c407c5d5a72e87d70ec66267"}
Sep 11 13:11:59.169920 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.169658    2572 scope.go:117] "RemoveContainer" containerID="49c4f71a5ceaa3cdceffce0c024cc6e9644527b60c35102b508254cf78962042"
Sep 11 13:11:59.297195 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.297173    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:11:59.422757 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422714    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-credential-socket\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422757 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422763    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-istio-token\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422830    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-envoy\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422877    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ee0981-9349-4294-ae29-69a2843621d2-istiod-ca-cert\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422896    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-socket\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422912    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktwrz\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-kube-api-access-ktwrz\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422934    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ee0981-9349-4294-ae29-69a2843621d2-istio-podinfo\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422966    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-certs\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.422991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.422979    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:59.423367 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.423000    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-data\") pod \"94ee0981-9349-4294-ae29-69a2843621d2\" (UID: \"94ee0981-9349-4294-ae29-69a2843621d2\") "
Sep 11 13:11:59.423367 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.423186    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:59.423367 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.423338    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ee0981-9349-4294-ae29-69a2843621d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:59.423536 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.423394    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.423536 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.423411    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.423536 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.423466    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:59.423702 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.423593    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:59.425168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.425144    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:59.425419 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.425390    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-kube-api-access-ktwrz" (OuterVolumeSpecName: "kube-api-access-ktwrz") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "kube-api-access-ktwrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:59.425419 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.425408    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:59.425612 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.425594    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94ee0981-9349-4294-ae29-69a2843621d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94ee0981-9349-4294-ae29-69a2843621d2" (UID: "94ee0981-9349-4294-ae29-69a2843621d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:11:59.523895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.523865    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.523895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.523891    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.523895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.523900    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ee0981-9349-4294-ae29-69a2843621d2-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.524119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.523909    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktwrz\" (UniqueName: \"kubernetes.io/projected/94ee0981-9349-4294-ae29-69a2843621d2-kube-api-access-ktwrz\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.524119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.523918    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ee0981-9349-4294-ae29-69a2843621d2-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.524119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.523925    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:11:59.524119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:11:59.523933    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ee0981-9349-4294-ae29-69a2843621d2-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:00.176211 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:00.176188    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"
Sep 11 13:12:00.176622 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:00.176227    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz" event={"ID":"94ee0981-9349-4294-ae29-69a2843621d2","Type":"ContainerDied","Data":"cc345350d9619ae660d92a8b095c67f80cd0e34dd14f1d54abd6633c67bbd3ef"}
Sep 11 13:12:00.176622 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:00.176280    2572 scope.go:117] "RemoveContainer" containerID="8393e97b83054cd459bf05b1f09c27f8dc622514c407c5d5a72e87d70ec66267"
Sep 11 13:12:00.205168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:00.205141    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"]
Sep 11 13:12:00.207149 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:00.207127    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f27fde90-openshift-default-6c69dc548d-g4ctz"]
Sep 11 13:12:02.139634 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:02.139592    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ee0981-9349-4294-ae29-69a2843621d2" path="/var/lib/kubelet/pods/94ee0981-9349-4294-ae29-69a2843621d2/volumes"
Sep 11 13:12:13.908687 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.908653    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-fd8dce"]
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909020    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909033    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909044    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ee0752-a693-4170-9fac-051d36398c5b" containerName="payload-pre-processing"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909051    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ee0752-a693-4170-9fac-051d36398c5b" containerName="payload-pre-processing"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909057    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c172959-6a8f-49b9-8aa9-e22eee33b4ee" containerName="revoke-keys"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909063    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c172959-6a8f-49b9-8aa9-e22eee33b4ee" containerName="revoke-keys"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909072    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909077    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909088    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0303e596-9832-41cd-ae11-2ec0670c838b" containerName="main"
Sep 11 13:12:13.909093 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909093    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0303e596-9832-41cd-ae11-2ec0670c838b" containerName="main"
Sep 11 13:12:13.909462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909152    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ee0752-a693-4170-9fac-051d36398c5b" containerName="payload-pre-processing"
Sep 11 13:12:13.909462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909159    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0303e596-9832-41cd-ae11-2ec0670c838b" containerName="main"
Sep 11 13:12:13.909462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909166    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c172959-6a8f-49b9-8aa9-e22eee33b4ee" containerName="revoke-keys"
Sep 11 13:12:13.909462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909171    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy"
Sep 11 13:12:13.909462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.909179    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ee0981-9349-4294-ae29-69a2843621d2" containerName="istio-proxy"
Sep 11 13:12:13.913572 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.913551    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-fd8dce"
Sep 11 13:12:13.915744 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.915714    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-52h42\""
Sep 11 13:12:13.918618 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.918593    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-fd8dce"]
Sep 11 13:12:13.956498 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:13.956473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d8jp\" (UniqueName: \"kubernetes.io/projected/1cb98263-7264-44f7-8a3c-f1f4c8fdde0c-kube-api-access-9d8jp\") pod \"test-curl-7797-fd8dce\" (UID: \"1cb98263-7264-44f7-8a3c-f1f4c8fdde0c\") " pod="opendatahub/test-curl-7797-fd8dce"
Sep 11 13:12:14.057399 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:14.057356    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d8jp\" (UniqueName: \"kubernetes.io/projected/1cb98263-7264-44f7-8a3c-f1f4c8fdde0c-kube-api-access-9d8jp\") pod \"test-curl-7797-fd8dce\" (UID: \"1cb98263-7264-44f7-8a3c-f1f4c8fdde0c\") " pod="opendatahub/test-curl-7797-fd8dce"
Sep 11 13:12:14.066552 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:14.066523    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d8jp\" (UniqueName: \"kubernetes.io/projected/1cb98263-7264-44f7-8a3c-f1f4c8fdde0c-kube-api-access-9d8jp\") pod \"test-curl-7797-fd8dce\" (UID: \"1cb98263-7264-44f7-8a3c-f1f4c8fdde0c\") " pod="opendatahub/test-curl-7797-fd8dce"
Sep 11 13:12:14.224167 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:14.224091    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-fd8dce"
Sep 11 13:12:14.496269 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:14.496201    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-fd8dce"]
Sep 11 13:12:14.498571 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:12:14.498542    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cb98263_7264_44f7_8a3c_f1f4c8fdde0c.slice/crio-1eca947a4bffbb106bd16c00db58e0601eced1f19851543800c64db7ebddd701 WatchSource:0}: Error finding container 1eca947a4bffbb106bd16c00db58e0601eced1f19851543800c64db7ebddd701: Status 404 returned error can't find the container with id 1eca947a4bffbb106bd16c00db58e0601eced1f19851543800c64db7ebddd701
Sep 11 13:12:15.271833 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:15.271796    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-fd8dce" event={"ID":"1cb98263-7264-44f7-8a3c-f1f4c8fdde0c","Type":"ContainerStarted","Data":"c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd"}
Sep 11 13:12:15.271833 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:15.271839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-fd8dce" event={"ID":"1cb98263-7264-44f7-8a3c-f1f4c8fdde0c","Type":"ContainerStarted","Data":"1eca947a4bffbb106bd16c00db58e0601eced1f19851543800c64db7ebddd701"}
Sep 11 13:12:15.286934 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:15.286884    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7797-fd8dce" podStartSLOduration=2.286868439 podStartE2EDuration="2.286868439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:12:15.285570116 +0000 UTC m=+1499.665096044" watchObservedRunningTime="2026-09-11 13:12:15.286868439 +0000 UTC m=+1499.666394374"
Sep 11 13:12:15.891484 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:15.891442    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-fd8dce"]
Sep 11 13:12:15.893981 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:15.893953    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-fd8dce"]
Sep 11 13:12:16.152468 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:16.152440    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:12:16.156171 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:16.156151    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:12:16.276957 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:12:16.276929    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7797-fd8dce" container="test-curl-7797-fd8dce"
Sep 11 13:12:16.337385 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:16.337359    2572 scope.go:117] "RemoveContainer" containerID="016cdea02e8acb91172db0ff65b2d779c4741e4c3163d1d2e5de11ef2d4dff9f"
Sep 11 13:12:17.281435 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:17.281366    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7797-fd8dce" podUID="1cb98263-7264-44f7-8a3c-f1f4c8fdde0c" containerName="test-curl-7797-fd8dce" containerID="cri-o://c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd" gracePeriod=2
Sep 11 13:12:17.372394 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:17.372366    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"]
Sep 11 13:12:19.466196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:19.466173    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-fd8dce"
Sep 11 13:12:19.508655 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:19.508627    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d8jp\" (UniqueName: \"kubernetes.io/projected/1cb98263-7264-44f7-8a3c-f1f4c8fdde0c-kube-api-access-9d8jp\") pod \"1cb98263-7264-44f7-8a3c-f1f4c8fdde0c\" (UID: \"1cb98263-7264-44f7-8a3c-f1f4c8fdde0c\") "
Sep 11 13:12:19.510803 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:19.510779    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb98263-7264-44f7-8a3c-f1f4c8fdde0c-kube-api-access-9d8jp" (OuterVolumeSpecName: "kube-api-access-9d8jp") pod "1cb98263-7264-44f7-8a3c-f1f4c8fdde0c" (UID: "1cb98263-7264-44f7-8a3c-f1f4c8fdde0c"). InnerVolumeSpecName "kube-api-access-9d8jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:19.610033 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:19.609950    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d8jp\" (UniqueName: \"kubernetes.io/projected/1cb98263-7264-44f7-8a3c-f1f4c8fdde0c-kube-api-access-9d8jp\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:20.139718 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:20.139682    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cb98263-7264-44f7-8a3c-f1f4c8fdde0c" path="/var/lib/kubelet/pods/1cb98263-7264-44f7-8a3c-f1f4c8fdde0c/volumes"
Sep 11 13:12:20.297562 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:20.297525    2572 generic.go:356] "Generic (PLEG): container finished" podID="1cb98263-7264-44f7-8a3c-f1f4c8fdde0c" containerID="c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd" exitCode=137
Sep 11 13:12:20.297725 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:20.297568    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-fd8dce"
Sep 11 13:12:20.297725 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:20.297633    2572 scope.go:117] "RemoveContainer" containerID="c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd"
Sep 11 13:12:20.306213 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:20.306194    2572 scope.go:117] "RemoveContainer" containerID="c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd"
Sep 11 13:12:20.306538 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:12:20.306513    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd\": container with ID starting with c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd not found: ID does not exist" containerID="c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd"
Sep 11 13:12:20.306596 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:20.306548    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd"} err="failed to get container status \"c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd\": rpc error: code = NotFound desc = could not find container \"c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd\": container with ID starting with c73bfe3d080a9bbf1fc8ecb2025ce6ab0083a1f9647ff1aa0c5acb9f966879dd not found: ID does not exist"
Sep 11 13:12:32.392385 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.392299    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6" podUID="d1f43b6f-2eb4-4912-8305-b149e90e760a" containerName="main" containerID="cri-o://6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d" gracePeriod=45
Sep 11 13:12:32.646902 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.646882    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:12:32.737142 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737109    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f43b6f-2eb4-4912-8305-b149e90e760a-tls-certs\") pod \"d1f43b6f-2eb4-4912-8305-b149e90e760a\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") "
Sep 11 13:12:32.737347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737164    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-tmp-dir\") pod \"d1f43b6f-2eb4-4912-8305-b149e90e760a\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") "
Sep 11 13:12:32.737347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737199    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6msrs\" (UniqueName: \"kubernetes.io/projected/d1f43b6f-2eb4-4912-8305-b149e90e760a-kube-api-access-6msrs\") pod \"d1f43b6f-2eb4-4912-8305-b149e90e760a\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") "
Sep 11 13:12:32.737347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737226    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-model-cache\") pod \"d1f43b6f-2eb4-4912-8305-b149e90e760a\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") "
Sep 11 13:12:32.737347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737272    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-dshm\") pod \"d1f43b6f-2eb4-4912-8305-b149e90e760a\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") "
Sep 11 13:12:32.737347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737347    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-home\") pod \"d1f43b6f-2eb4-4912-8305-b149e90e760a\" (UID: \"d1f43b6f-2eb4-4912-8305-b149e90e760a\") "
Sep 11 13:12:32.737613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1f43b6f-2eb4-4912-8305-b149e90e760a" (UID: "d1f43b6f-2eb4-4912-8305-b149e90e760a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:32.737613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737557    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1f43b6f-2eb4-4912-8305-b149e90e760a" (UID: "d1f43b6f-2eb4-4912-8305-b149e90e760a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:32.737754 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737731    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-tmp-dir\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:32.737816 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737760    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-model-cache\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:32.737872 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.737811    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-home" (OuterVolumeSpecName: "home") pod "d1f43b6f-2eb4-4912-8305-b149e90e760a" (UID: "d1f43b6f-2eb4-4912-8305-b149e90e760a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:32.739617 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.739592    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1f43b6f-2eb4-4912-8305-b149e90e760a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1f43b6f-2eb4-4912-8305-b149e90e760a" (UID: "d1f43b6f-2eb4-4912-8305-b149e90e760a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:12:32.739734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.739648    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-dshm" (OuterVolumeSpecName: "dshm") pod "d1f43b6f-2eb4-4912-8305-b149e90e760a" (UID: "d1f43b6f-2eb4-4912-8305-b149e90e760a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:32.739734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.739654    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f43b6f-2eb4-4912-8305-b149e90e760a-kube-api-access-6msrs" (OuterVolumeSpecName: "kube-api-access-6msrs") pod "d1f43b6f-2eb4-4912-8305-b149e90e760a" (UID: "d1f43b6f-2eb4-4912-8305-b149e90e760a"). InnerVolumeSpecName "kube-api-access-6msrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:32.839111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.839077    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1f43b6f-2eb4-4912-8305-b149e90e760a-tls-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:32.839111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.839107    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6msrs\" (UniqueName: \"kubernetes.io/projected/d1f43b6f-2eb4-4912-8305-b149e90e760a-kube-api-access-6msrs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:32.839286 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.839121    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-dshm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:32.839286 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:32.839134    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1f43b6f-2eb4-4912-8305-b149e90e760a-home\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:12:33.361233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.361199    2572 generic.go:356] "Generic (PLEG): container finished" podID="d1f43b6f-2eb4-4912-8305-b149e90e760a" containerID="6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d" exitCode=0
Sep 11 13:12:33.361453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.361251    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"
Sep 11 13:12:33.361453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.361286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6" event={"ID":"d1f43b6f-2eb4-4912-8305-b149e90e760a","Type":"ContainerDied","Data":"6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d"}
Sep 11 13:12:33.361453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.361353    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6" event={"ID":"d1f43b6f-2eb4-4912-8305-b149e90e760a","Type":"ContainerDied","Data":"1c77ecd4fbf20b5cbee8fe849ff6c8dedbb1b331cc47127100ca3776077d1d6d"}
Sep 11 13:12:33.361453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.361373    2572 scope.go:117] "RemoveContainer" containerID="6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d"
Sep 11 13:12:33.372506 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.372484    2572 scope.go:117] "RemoveContainer" containerID="6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d"
Sep 11 13:12:33.372915 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:12:33.372889    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d\": container with ID starting with 6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d not found: ID does not exist" containerID="6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d"
Sep 11 13:12:33.373021 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.372927    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d"} err="failed to get container status \"6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d\": rpc error: code = NotFound desc = could not find container \"6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d\": container with ID starting with 6372090dda25e30cdcb6db423a2fb3f78c0fc110c147734c58221afa728d410d not found: ID does not exist"
Sep 11 13:12:33.384210 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.384186    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"]
Sep 11 13:12:33.386011 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:33.385993    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/auth-test-model-d4b0b9-kserve-7bf69b8795-6p4v6"]
Sep 11 13:12:34.139408 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:34.139378    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1f43b6f-2eb4-4912-8305-b149e90e760a" path="/var/lib/kubelet/pods/d1f43b6f-2eb4-4912-8305-b149e90e760a/volumes"
Sep 11 13:12:49.258063 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.258019    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"]
Sep 11 13:12:49.258735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.258478    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f43b6f-2eb4-4912-8305-b149e90e760a" containerName="main"
Sep 11 13:12:49.258735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.258496    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f43b6f-2eb4-4912-8305-b149e90e760a" containerName="main"
Sep 11 13:12:49.258735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.258573    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb98263-7264-44f7-8a3c-f1f4c8fdde0c" containerName="test-curl-7797-fd8dce"
Sep 11 13:12:49.258735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.258585    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb98263-7264-44f7-8a3c-f1f4c8fdde0c" containerName="test-curl-7797-fd8dce"
Sep 11 13:12:49.258735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.258706    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f43b6f-2eb4-4912-8305-b149e90e760a" containerName="main"
Sep 11 13:12:49.258735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.258722    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cb98263-7264-44f7-8a3c-f1f4c8fdde0c" containerName="test-curl-7797-fd8dce"
Sep 11 13:12:49.261806 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.261784    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.265001 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.264976    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-940f81-openshift-default-dockercfg-q6lzx\""
Sep 11 13:12:49.276953 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.276928    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"]
Sep 11 13:12:49.292697 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-data\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.292859 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292705    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-socket\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.292859 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istiod-ca-cert\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.292859 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcdqh\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-kube-api-access-rcdqh\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.292859 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-envoy\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.293016 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-credential-socket\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.293016 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-certs\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.293016 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-token\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.293016 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.292960    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-podinfo\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393480 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-podinfo\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393480 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393487    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-data\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393509    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-socket\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393530    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istiod-ca-cert\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcdqh\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-kube-api-access-rcdqh\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393578    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-envoy\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393617    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-credential-socket\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.393735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-certs\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.394054 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-token\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.394054 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393906    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-data\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.394054 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.393933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-certs\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.394054 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.394045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-credential-socket\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.394270 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.394253    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-socket\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.394837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.394816    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istiod-ca-cert\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.396145 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.396123    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-envoy\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.396233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.396161    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-podinfo\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.402547 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.402524    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-token\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.402646 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.402619    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcdqh\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-kube-api-access-rcdqh\") pod \"e2e-api-a-940f81-openshift-default-687d968956-lzmh7\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") " pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.572493 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.572400    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:49.848442 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.848418    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"]
Sep 11 13:12:49.850539 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:12:49.850511    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ca6d6b_f5a6_4b93_b241_e2e46a74930c.slice/crio-c3f975689e0977d30a82798d1ea8794aa83d198a973291120b26688d515bb286 WatchSource:0}: Error finding container c3f975689e0977d30a82798d1ea8794aa83d198a973291120b26688d515bb286: Status 404 returned error can't find the container with id c3f975689e0977d30a82798d1ea8794aa83d198a973291120b26688d515bb286
Sep 11 13:12:49.853113 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.853079    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:12:49.853189 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.853144    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:12:49.853189 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:49.853172    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:12:50.447850 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:50.447814    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" event={"ID":"04ca6d6b-f5a6-4b93-b241-e2e46a74930c","Type":"ContainerStarted","Data":"04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972"}
Sep 11 13:12:50.448381 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:50.447877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" event={"ID":"04ca6d6b-f5a6-4b93-b241-e2e46a74930c","Type":"ContainerStarted","Data":"c3f975689e0977d30a82798d1ea8794aa83d198a973291120b26688d515bb286"}
Sep 11 13:12:50.469587 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:50.469528    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podStartSLOduration=1.469506901 podStartE2EDuration="1.469506901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:12:50.468349788 +0000 UTC m=+1534.847875715" watchObservedRunningTime="2026-09-11 13:12:50.469506901 +0000 UTC m=+1534.849032840"
Sep 11 13:12:50.573144 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:50.573104    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:50.585772 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:50.585740    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:51.452887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:51.452859    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:51.453865 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:51.453846    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:12:54.410560 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.410524    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"]
Sep 11 13:12:54.413964 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.413946    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.417472 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.417453    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-940f81-dockercfg-gl6d7\""
Sep 11 13:12:54.420704 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.420687    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-940f81\""
Sep 11 13:12:54.427603 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.427581    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"]
Sep 11 13:12:54.439294 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.439268    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6291d3b-c645-48d5-87c6-0e803129eeff-plugins-config-volume\") pod \"payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") " pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.439490 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.439467    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xxhc\" (UniqueName: \"kubernetes.io/projected/b6291d3b-c645-48d5-87c6-0e803129eeff-kube-api-access-6xxhc\") pod \"payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") " pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.540209 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.540179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xxhc\" (UniqueName: \"kubernetes.io/projected/b6291d3b-c645-48d5-87c6-0e803129eeff-kube-api-access-6xxhc\") pod \"payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") " pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.540491 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.540227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6291d3b-c645-48d5-87c6-0e803129eeff-plugins-config-volume\") pod \"payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") " pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.541002 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.540984    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6291d3b-c645-48d5-87c6-0e803129eeff-plugins-config-volume\") pod \"payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") " pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.549071 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.549046    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xxhc\" (UniqueName: \"kubernetes.io/projected/b6291d3b-c645-48d5-87c6-0e803129eeff-kube-api-access-6xxhc\") pod \"payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") " pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.725224 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.725136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:54.998453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:54.998387    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"]
Sep 11 13:12:55.000862 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:12:55.000835    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6291d3b_c645_48d5_87c6_0e803129eeff.slice/crio-cc1feac81f37b3ebe554ed25d240122c97ee6c697128f2f2ee795df27682165f WatchSource:0}: Error finding container cc1feac81f37b3ebe554ed25d240122c97ee6c697128f2f2ee795df27682165f: Status 404 returned error can't find the container with id cc1feac81f37b3ebe554ed25d240122c97ee6c697128f2f2ee795df27682165f
Sep 11 13:12:55.475913 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:55.475881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n" event={"ID":"b6291d3b-c645-48d5-87c6-0e803129eeff","Type":"ContainerStarted","Data":"e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1"}
Sep 11 13:12:55.476386 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:55.475955    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n" event={"ID":"b6291d3b-c645-48d5-87c6-0e803129eeff","Type":"ContainerStarted","Data":"cc1feac81f37b3ebe554ed25d240122c97ee6c697128f2f2ee795df27682165f"}
Sep 11 13:12:55.476386 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:55.476007    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:12:55.495842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:12:55.495771    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n" podStartSLOduration=1.4957579 podStartE2EDuration="1.4957579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:12:55.493413678 +0000 UTC m=+1539.872939614" watchObservedRunningTime="2026-09-11 13:12:55.4957579 +0000 UTC m=+1539.875283836"
Sep 11 13:13:06.481468 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:06.481441    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:13:13.564613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:13.564576    2572 generic.go:356] "Generic (PLEG): container finished" podID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerID="04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972" exitCode=0
Sep 11 13:13:13.565032 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:13.564664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" event={"ID":"04ca6d6b-f5a6-4b93-b241-e2e46a74930c","Type":"ContainerDied","Data":"04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972"}
Sep 11 13:13:13.565075 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:13.565065    2572 scope.go:117] "RemoveContainer" containerID="04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972"
Sep 11 13:13:13.566120 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:13.566093    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:13.566186 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:13.566162    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:13.566222 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:13.566198    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:14.571541 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:14.571503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" event={"ID":"04ca6d6b-f5a6-4b93-b241-e2e46a74930c","Type":"ContainerStarted","Data":"4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5"}
Sep 11 13:13:14.572961 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:14.572942    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:13:14.573086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:14.573058    2572 patch_prober.go:28] interesting pod/e2e-api-a-940f81-openshift-default-687d968956-lzmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 13:13:14.573130 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:14.573110    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 13:13:15.572697 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:15.572667    2572 patch_prober.go:28] interesting pod/e2e-api-a-940f81-openshift-default-687d968956-lzmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 13:13:15.573049 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:15.572736    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 13:13:16.363008 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:16.362978    2572 scope.go:117] "RemoveContainer" containerID="60b842fceef8a5213c33f95d73e8a35105fe67147078f1d15ad06aeb0977bce8"
Sep 11 13:13:16.573070 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:16.573032    2572 patch_prober.go:28] interesting pod/e2e-api-a-940f81-openshift-default-687d968956-lzmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 13:13:16.573532 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:16.573090    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 13:13:17.573147 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:17.573115    2572 patch_prober.go:28] interesting pod/e2e-api-a-940f81-openshift-default-687d968956-lzmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 13:13:17.573565 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:17.573178    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 13:13:18.216883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.214308    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"]
Sep 11 13:13:18.221364 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.221308    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"]
Sep 11 13:13:18.221635 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.221616    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.225589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.225567    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ccae06-openshift-default-dockercfg-f2g5n\""
Sep 11 13:13:18.270178 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-credential-socket\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270438 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-podinfo\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270438 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfwmp\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-kube-api-access-gfwmp\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270438 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istiod-ca-cert\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270438 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270369    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-token\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270438 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-envoy\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270453    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-socket\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-certs\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.270623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.270528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-data\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372024 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.371993    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-data\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-credential-socket\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372102    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-podinfo\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfwmp\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-kube-api-access-gfwmp\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istiod-ca-cert\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-token\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-envoy\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372611 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-socket\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372611 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372290    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-certs\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372611 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-data\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372611 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372539    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-credential-socket\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372819 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372678    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-certs\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.372877 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.372856    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-socket\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.373132 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.373109    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istiod-ca-cert\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.374782 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.374759    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-envoy\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.374871 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.374840    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-podinfo\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.380376 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.380353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-token\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.380453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.380418    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfwmp\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-kube-api-access-gfwmp\") pod \"e2e-api-b-ccae06-openshift-default-7846765494-pj52t\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") " pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.533923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.533837    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:18.573724 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.573690    2572 patch_prober.go:28] interesting pod/e2e-api-a-940f81-openshift-default-687d968956-lzmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 13:13:18.574080 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.573756    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 13:13:18.832746 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.832723    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"]
Sep 11 13:13:18.835020 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:13:18.834985    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e3b1a7_b15d_4926_9ed1_e0d9f58c4dc1.slice/crio-ba807901ee49e91a0238ddbc6de8bdf85b7ea3c2f0b019a52c315caf4ad8d5a7 WatchSource:0}: Error finding container ba807901ee49e91a0238ddbc6de8bdf85b7ea3c2f0b019a52c315caf4ad8d5a7: Status 404 returned error can't find the container with id ba807901ee49e91a0238ddbc6de8bdf85b7ea3c2f0b019a52c315caf4ad8d5a7
Sep 11 13:13:18.837405 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.837370    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:18.837522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.837437    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:18.837522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:18.837463    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:19.573578 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:19.573533    2572 patch_prober.go:28] interesting pod/e2e-api-a-940f81-openshift-default-687d968956-lzmh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 13:13:19.573809 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:19.573600    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 13:13:19.614543 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:19.614506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" event={"ID":"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1","Type":"ContainerStarted","Data":"d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604"}
Sep 11 13:13:19.614739 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:19.614594    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" event={"ID":"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1","Type":"ContainerStarted","Data":"ba807901ee49e91a0238ddbc6de8bdf85b7ea3c2f0b019a52c315caf4ad8d5a7"}
Sep 11 13:13:19.647935 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:19.647877    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" podStartSLOduration=1.6478537119999999 podStartE2EDuration="1.647853712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:19.64585444 +0000 UTC m=+1564.025380389" watchObservedRunningTime="2026-09-11 13:13:19.647853712 +0000 UTC m=+1564.027379647"
Sep 11 13:13:20.534813 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:20.534783    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:20.539957 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:20.539933    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:20.577469 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:20.577443    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:13:20.577905 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:20.577783    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:13:20.578304 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:20.578287    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:13:20.620150 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:20.620125    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:20.621044 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:20.621027    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:39.723219 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:39.723183    2572 generic.go:356] "Generic (PLEG): container finished" podID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerID="d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604" exitCode=0
Sep 11 13:13:39.723660 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:39.723256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" event={"ID":"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1","Type":"ContainerDied","Data":"d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604"}
Sep 11 13:13:39.723703 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:39.723680    2572 scope.go:117] "RemoveContainer" containerID="d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604"
Sep 11 13:13:39.724823 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:39.724797    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:39.724885 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:39.724865    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:39.724922 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:39.724896    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:13:40.730770 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:40.730734    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" event={"ID":"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1","Type":"ContainerStarted","Data":"b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771"}
Sep 11 13:13:41.534150 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:41.534110    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:41.534351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:41.534300    2572 patch_prober.go:28] interesting pod/e2e-api-b-ccae06-openshift-default-7846765494-pj52t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:13:41.534436 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:41.534377    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 13:13:42.535008 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:42.534971    2572 patch_prober.go:28] interesting pod/e2e-api-b-ccae06-openshift-default-7846765494-pj52t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:13:42.535512 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:42.535034    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 13:13:43.534544 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:43.534509    2572 patch_prober.go:28] interesting pod/e2e-api-b-ccae06-openshift-default-7846765494-pj52t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:13:43.534733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:43.534565    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 13:13:44.535211 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:44.535172    2572 patch_prober.go:28] interesting pod/e2e-api-b-ccae06-openshift-default-7846765494-pj52t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:13:44.535644 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:44.535235    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 13:13:45.534755 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:45.534716    2572 patch_prober.go:28] interesting pod/e2e-api-b-ccae06-openshift-default-7846765494-pj52t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:13:45.534941 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:45.534788    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 11 13:13:46.538440 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:46.538412    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:46.538843 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:46.538757    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:46.539482 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:46.539466    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:13:49.556857 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.556825    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"]
Sep 11 13:13:49.560199 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.560180    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"
Sep 11 13:13:49.562291 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.562263    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:13:49.562291 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.562281    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:13:49.568002 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.567977    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"]
Sep 11 13:13:49.598895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.598871    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9403a684-d257-4701-910c-f51dc7a33adf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-940f81-sfm92\" (UID: \"9403a684-d257-4701-910c-f51dc7a33adf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"
Sep 11 13:13:49.699998 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.699970    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9403a684-d257-4701-910c-f51dc7a33adf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-940f81-sfm92\" (UID: \"9403a684-d257-4701-910c-f51dc7a33adf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"
Sep 11 13:13:49.700699 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.700682    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9403a684-d257-4701-910c-f51dc7a33adf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-940f81-sfm92\" (UID: \"9403a684-d257-4701-910c-f51dc7a33adf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"
Sep 11 13:13:49.871349 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:49.871250    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"
Sep 11 13:13:50.141502 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:50.141476    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"]
Sep 11 13:13:50.142769 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:13:50.142733    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9403a684_d257_4701_910c_f51dc7a33adf.slice/crio-442031c58def75d2235494b4c290df351561c115e1d1b41d6cda0b297cbc687d WatchSource:0}: Error finding container 442031c58def75d2235494b4c290df351561c115e1d1b41d6cda0b297cbc687d: Status 404 returned error can't find the container with id 442031c58def75d2235494b4c290df351561c115e1d1b41d6cda0b297cbc687d
Sep 11 13:13:50.779872 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:50.779839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92" event={"ID":"9403a684-d257-4701-910c-f51dc7a33adf","Type":"ContainerStarted","Data":"fcf24df750f4c9f09cddb2fbdce536b85c938a37e4f82ec5dfbe6e292403878c"}
Sep 11 13:13:50.780245 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:50.779891    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92" event={"ID":"9403a684-d257-4701-910c-f51dc7a33adf","Type":"ContainerStarted","Data":"442031c58def75d2235494b4c290df351561c115e1d1b41d6cda0b297cbc687d"}
Sep 11 13:13:50.799140 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:50.799099    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92" podStartSLOduration=1.7990829910000001 podStartE2EDuration="1.799082991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:50.796778657 +0000 UTC m=+1595.176304604" watchObservedRunningTime="2026-09-11 13:13:50.799082991 +0000 UTC m=+1595.178608923"
Sep 11 13:13:51.788482 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:51.788447    2572 generic.go:356] "Generic (PLEG): container finished" podID="9403a684-d257-4701-910c-f51dc7a33adf" containerID="fcf24df750f4c9f09cddb2fbdce536b85c938a37e4f82ec5dfbe6e292403878c" exitCode=0
Sep 11 13:13:51.788889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:51.788539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92" event={"ID":"9403a684-d257-4701-910c-f51dc7a33adf","Type":"ContainerDied","Data":"fcf24df750f4c9f09cddb2fbdce536b85c938a37e4f82ec5dfbe6e292403878c"}
Sep 11 13:13:52.933374 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:52.933352    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"
Sep 11 13:13:53.033629 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:53.033602    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9403a684-d257-4701-910c-f51dc7a33adf-maas-api-service-ca\") pod \"9403a684-d257-4701-910c-f51dc7a33adf\" (UID: \"9403a684-d257-4701-910c-f51dc7a33adf\") "
Sep 11 13:13:53.033943 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:53.033922    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9403a684-d257-4701-910c-f51dc7a33adf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9403a684-d257-4701-910c-f51dc7a33adf" (UID: "9403a684-d257-4701-910c-f51dc7a33adf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:13:53.134721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:53.134640    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9403a684-d257-4701-910c-f51dc7a33adf-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:13:53.799397 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:53.799370    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"
Sep 11 13:13:53.799397 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:53.799381    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92" event={"ID":"9403a684-d257-4701-910c-f51dc7a33adf","Type":"ContainerDied","Data":"442031c58def75d2235494b4c290df351561c115e1d1b41d6cda0b297cbc687d"}
Sep 11 13:13:53.799647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:13:53.799427    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="442031c58def75d2235494b4c290df351561c115e1d1b41d6cda0b297cbc687d"
Sep 11 13:14:05.553429 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.553396    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"]
Sep 11 13:14:05.553857 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.553636    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n" podUID="b6291d3b-c645-48d5-87c6-0e803129eeff" containerName="payload-processing" containerID="cri-o://e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1" gracePeriod=30
Sep 11 13:14:05.790584 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.790550    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"]
Sep 11 13:14:05.796405 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.796373    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-940f81-sfm92"]
Sep 11 13:14:05.813367 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.813294    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:14:05.866360 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.865997    2572 generic.go:356] "Generic (PLEG): container finished" podID="b6291d3b-c645-48d5-87c6-0e803129eeff" containerID="e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1" exitCode=0
Sep 11 13:14:05.866360 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.866140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n" event={"ID":"b6291d3b-c645-48d5-87c6-0e803129eeff","Type":"ContainerDied","Data":"e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1"}
Sep 11 13:14:05.866360 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.866191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n" event={"ID":"b6291d3b-c645-48d5-87c6-0e803129eeff","Type":"ContainerDied","Data":"cc1feac81f37b3ebe554ed25d240122c97ee6c697128f2f2ee795df27682165f"}
Sep 11 13:14:05.866360 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.866222    2572 scope.go:117] "RemoveContainer" containerID="e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1"
Sep 11 13:14:05.867269 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.866885    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"
Sep 11 13:14:05.892023 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.890250    2572 scope.go:117] "RemoveContainer" containerID="e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1"
Sep 11 13:14:05.892972 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:05.892941    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1\": container with ID starting with e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1 not found: ID does not exist" containerID="e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1"
Sep 11 13:14:05.893120 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.892986    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1"} err="failed to get container status \"e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1\": rpc error: code = NotFound desc = could not find container \"e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1\": container with ID starting with e21d914877435ae3b39f45fc024369e489a031d9b69b42d922abd51a0b6a99a1 not found: ID does not exist"
Sep 11 13:14:05.971727 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.971687    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6291d3b-c645-48d5-87c6-0e803129eeff-plugins-config-volume\") pod \"b6291d3b-c645-48d5-87c6-0e803129eeff\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") "
Sep 11 13:14:05.971727 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.971731    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xxhc\" (UniqueName: \"kubernetes.io/projected/b6291d3b-c645-48d5-87c6-0e803129eeff-kube-api-access-6xxhc\") pod \"b6291d3b-c645-48d5-87c6-0e803129eeff\" (UID: \"b6291d3b-c645-48d5-87c6-0e803129eeff\") "
Sep 11 13:14:05.972049 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.972026    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6291d3b-c645-48d5-87c6-0e803129eeff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6291d3b-c645-48d5-87c6-0e803129eeff" (UID: "b6291d3b-c645-48d5-87c6-0e803129eeff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:05.974035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:05.974013    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6291d3b-c645-48d5-87c6-0e803129eeff-kube-api-access-6xxhc" (OuterVolumeSpecName: "kube-api-access-6xxhc") pod "b6291d3b-c645-48d5-87c6-0e803129eeff" (UID: "b6291d3b-c645-48d5-87c6-0e803129eeff"). InnerVolumeSpecName "kube-api-access-6xxhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:06.073231 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:06.073153    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6291d3b-c645-48d5-87c6-0e803129eeff-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:06.073231 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:06.073179    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xxhc\" (UniqueName: \"kubernetes.io/projected/b6291d3b-c645-48d5-87c6-0e803129eeff-kube-api-access-6xxhc\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:06.140429 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:06.140400    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9403a684-d257-4701-910c-f51dc7a33adf" path="/var/lib/kubelet/pods/9403a684-d257-4701-910c-f51dc7a33adf/volumes"
Sep 11 13:14:06.185270 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:06.185243    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"]
Sep 11 13:14:06.190374 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:06.190344    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-940f81-6b687779c5-gdr4n"]
Sep 11 13:14:08.140089 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:08.139999    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6291d3b-c645-48d5-87c6-0e803129eeff" path="/var/lib/kubelet/pods/b6291d3b-c645-48d5-87c6-0e803129eeff/volumes"
Sep 11 13:14:13.138644 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.138614    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"]
Sep 11 13:14:13.139045 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.138826    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy" containerID="cri-o://4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5" gracePeriod=30
Sep 11 13:14:13.502478 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.502446    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"]
Sep 11 13:14:13.502932 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.502914    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6291d3b-c645-48d5-87c6-0e803129eeff" containerName="payload-processing"
Sep 11 13:14:13.503041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.502935    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6291d3b-c645-48d5-87c6-0e803129eeff" containerName="payload-processing"
Sep 11 13:14:13.503041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.502972    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9403a684-d257-4701-910c-f51dc7a33adf" containerName="revoke-keys"
Sep 11 13:14:13.503041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.502982    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9403a684-d257-4701-910c-f51dc7a33adf" containerName="revoke-keys"
Sep 11 13:14:13.503196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.503070    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6291d3b-c645-48d5-87c6-0e803129eeff" containerName="payload-processing"
Sep 11 13:14:13.503196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.503085    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9403a684-d257-4701-910c-f51dc7a33adf" containerName="revoke-keys"
Sep 11 13:14:13.507437 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.507412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"
Sep 11 13:14:13.512565 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.512543    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:14:13.512891 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.512873    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:14:13.524430 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.524402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"]
Sep 11 13:14:13.535561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.535535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f62378a-be93-4d3d-90f2-cfdca4a526f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx\" (UID: \"4f62378a-be93-4d3d-90f2-cfdca4a526f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"
Sep 11 13:14:13.636577 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.636537    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f62378a-be93-4d3d-90f2-cfdca4a526f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx\" (UID: \"4f62378a-be93-4d3d-90f2-cfdca4a526f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"
Sep 11 13:14:13.637177 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.637155    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f62378a-be93-4d3d-90f2-cfdca4a526f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx\" (UID: \"4f62378a-be93-4d3d-90f2-cfdca4a526f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"
Sep 11 13:14:13.817214 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:13.817141    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"
Sep 11 13:14:14.087304 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:14.087275    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"]
Sep 11 13:14:14.089164 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:14:14.089139    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f62378a_be93_4d3d_90f2_cfdca4a526f4.slice/crio-83382181a0c5f00b7f1be1d2062709af7acf6f156b2bcb5a325f2df376be383e WatchSource:0}: Error finding container 83382181a0c5f00b7f1be1d2062709af7acf6f156b2bcb5a325f2df376be383e: Status 404 returned error can't find the container with id 83382181a0c5f00b7f1be1d2062709af7acf6f156b2bcb5a325f2df376be383e
Sep 11 13:14:14.914584 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:14.914555    2572 generic.go:356] "Generic (PLEG): container finished" podID="4f62378a-be93-4d3d-90f2-cfdca4a526f4" containerID="c3a917b68e13a00951dc7eb1af01c0654ea3e8a5298d5386e5fff47c7720d234" exitCode=0
Sep 11 13:14:14.914936 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:14.914609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx" event={"ID":"4f62378a-be93-4d3d-90f2-cfdca4a526f4","Type":"ContainerDied","Data":"c3a917b68e13a00951dc7eb1af01c0654ea3e8a5298d5386e5fff47c7720d234"}
Sep 11 13:14:14.914936 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:14.914673    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx" event={"ID":"4f62378a-be93-4d3d-90f2-cfdca4a526f4","Type":"ContainerStarted","Data":"83382181a0c5f00b7f1be1d2062709af7acf6f156b2bcb5a325f2df376be383e"}
Sep 11 13:14:16.050359 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:16.050330    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"
Sep 11 13:14:16.057598 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:16.057577    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f62378a-be93-4d3d-90f2-cfdca4a526f4-maas-api-service-ca\") pod \"4f62378a-be93-4d3d-90f2-cfdca4a526f4\" (UID: \"4f62378a-be93-4d3d-90f2-cfdca4a526f4\") "
Sep 11 13:14:16.057892 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:16.057871    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f62378a-be93-4d3d-90f2-cfdca4a526f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f62378a-be93-4d3d-90f2-cfdca4a526f4" (UID: "4f62378a-be93-4d3d-90f2-cfdca4a526f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:16.158763 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:16.158732    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f62378a-be93-4d3d-90f2-cfdca4a526f4-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:16.926505 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:16.926476    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"
Sep 11 13:14:16.926688 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:16.926515    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx" event={"ID":"4f62378a-be93-4d3d-90f2-cfdca4a526f4","Type":"ContainerDied","Data":"83382181a0c5f00b7f1be1d2062709af7acf6f156b2bcb5a325f2df376be383e"}
Sep 11 13:14:16.926688 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:16.926561    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83382181a0c5f00b7f1be1d2062709af7acf6f156b2bcb5a325f2df376be383e"
Sep 11 13:14:18.393142 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.393118    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:14:18.486694 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486606    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-certs\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.486694 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486658    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-credential-socket\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.486904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486726    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcdqh\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-kube-api-access-rcdqh\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.486904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486756    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-envoy\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.486904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486782    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-data\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.486904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486821    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-token\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.486904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486859    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istiod-ca-cert\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.486904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486887    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-podinfo\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.487218 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486912    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-socket\") pod \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\" (UID: \"04ca6d6b-f5a6-4b93-b241-e2e46a74930c\") "
Sep 11 13:14:18.487218 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.486914    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:18.487218 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.487034    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:18.487218 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.487087    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-data" (OuterVolumeSpecName: "istio-data") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:18.487479 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.487293    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.487479 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.487305    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:18.487479 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.487342    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.487479 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.487359    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.487479 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.487412    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:18.489275 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.489250    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-token" (OuterVolumeSpecName: "istio-token") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:18.489379 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.489333    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:14:18.489557 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.489540    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-kube-api-access-rcdqh" (OuterVolumeSpecName: "kube-api-access-rcdqh") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "kube-api-access-rcdqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:18.489605 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.489555    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04ca6d6b-f5a6-4b93-b241-e2e46a74930c" (UID: "04ca6d6b-f5a6-4b93-b241-e2e46a74930c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:18.588548 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.588497    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcdqh\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-kube-api-access-rcdqh\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.588548 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.588542    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.588548 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.588552    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.588548 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.588559    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.588548 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.588567    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.588856 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.588574    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04ca6d6b-f5a6-4b93-b241-e2e46a74930c-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:18.941047 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.941013    2572 generic.go:356] "Generic (PLEG): container finished" podID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerID="4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5" exitCode=0
Sep 11 13:14:18.941294 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.941070    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"
Sep 11 13:14:18.941294 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.941091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" event={"ID":"04ca6d6b-f5a6-4b93-b241-e2e46a74930c","Type":"ContainerDied","Data":"4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5"}
Sep 11 13:14:18.941294 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.941147    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7" event={"ID":"04ca6d6b-f5a6-4b93-b241-e2e46a74930c","Type":"ContainerDied","Data":"c3f975689e0977d30a82798d1ea8794aa83d198a973291120b26688d515bb286"}
Sep 11 13:14:18.941294 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.941169    2572 scope.go:117] "RemoveContainer" containerID="4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5"
Sep 11 13:14:18.950589 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.950571    2572 scope.go:117] "RemoveContainer" containerID="04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972"
Sep 11 13:14:18.958391 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.958373    2572 scope.go:117] "RemoveContainer" containerID="4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5"
Sep 11 13:14:18.958644 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:18.958625    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5\": container with ID starting with 4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5 not found: ID does not exist" containerID="4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5"
Sep 11 13:14:18.958709 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.958652    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5"} err="failed to get container status \"4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5\": rpc error: code = NotFound desc = could not find container \"4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5\": container with ID starting with 4eff06eb51d6bf34b20ecf6e9aef902d1d5e41364a30dbaa5e8b7903646815c5 not found: ID does not exist"
Sep 11 13:14:18.958709 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.958668    2572 scope.go:117] "RemoveContainer" containerID="04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972"
Sep 11 13:14:18.958910 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:18.958894    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972\": container with ID starting with 04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972 not found: ID does not exist" containerID="04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972"
Sep 11 13:14:18.958952 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.958916    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972"} err="failed to get container status \"04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972\": rpc error: code = NotFound desc = could not find container \"04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972\": container with ID starting with 04852132eb5a282fc7e85ca68fc2c28ab088ecdc9267ee9d003364d6f6caf972 not found: ID does not exist"
Sep 11 13:14:18.961816 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.961795    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"]
Sep 11 13:14:18.967864 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:18.967846    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-940f81-openshift-default-687d968956-lzmh7"]
Sep 11 13:14:20.139788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:20.139758    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" path="/var/lib/kubelet/pods/04ca6d6b-f5a6-4b93-b241-e2e46a74930c/volumes"
Sep 11 13:14:30.185126 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:30.185092    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"]
Sep 11 13:14:30.187756 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:30.187734    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ccae06-lvjrx"]
Sep 11 13:14:32.139889 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:32.139858    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f62378a-be93-4d3d-90f2-cfdca4a526f4" path="/var/lib/kubelet/pods/4f62378a-be93-4d3d-90f2-cfdca4a526f4/volumes"
Sep 11 13:14:36.610626 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:36.610590    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"]
Sep 11 13:14:36.611123 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:36.610807    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy" containerID="cri-o://b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771" gracePeriod=30
Sep 11 13:14:37.001428 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001394    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"]
Sep 11 13:14:37.001793 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001781    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f62378a-be93-4d3d-90f2-cfdca4a526f4" containerName="revoke-keys"
Sep 11 13:14:37.001846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001795    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f62378a-be93-4d3d-90f2-cfdca4a526f4" containerName="revoke-keys"
Sep 11 13:14:37.001846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001810    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy"
Sep 11 13:14:37.001846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001817    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy"
Sep 11 13:14:37.001846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001824    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy"
Sep 11 13:14:37.001846 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001830    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy"
Sep 11 13:14:37.002003 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001885    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f62378a-be93-4d3d-90f2-cfdca4a526f4" containerName="revoke-keys"
Sep 11 13:14:37.002003 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.001894    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy"
Sep 11 13:14:37.006073 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.006051    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"
Sep 11 13:14:37.008296 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.008274    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:14:37.008418 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.008279    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:14:37.015921 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.015896    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"]
Sep 11 13:14:37.158387 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.158345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75bee133-a804-48c6-85dc-60fcd20fb7f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq\" (UID: \"75bee133-a804-48c6-85dc-60fcd20fb7f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"
Sep 11 13:14:37.259214 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.259122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75bee133-a804-48c6-85dc-60fcd20fb7f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq\" (UID: \"75bee133-a804-48c6-85dc-60fcd20fb7f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"
Sep 11 13:14:37.259770 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.259750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75bee133-a804-48c6-85dc-60fcd20fb7f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq\" (UID: \"75bee133-a804-48c6-85dc-60fcd20fb7f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"
Sep 11 13:14:37.317262 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.317232    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"
Sep 11 13:14:37.589850 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:37.589774    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"]
Sep 11 13:14:37.592989 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:14:37.592964    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bee133_a804_48c6_85dc_60fcd20fb7f7.slice/crio-0316f48c38fbd1b5c05c331a741f8941b9ac4001b7cd8d64cb2676981d5f75de WatchSource:0}: Error finding container 0316f48c38fbd1b5c05c331a741f8941b9ac4001b7cd8d64cb2676981d5f75de: Status 404 returned error can't find the container with id 0316f48c38fbd1b5c05c331a741f8941b9ac4001b7cd8d64cb2676981d5f75de
Sep 11 13:14:38.041646 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:38.041611    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq" event={"ID":"75bee133-a804-48c6-85dc-60fcd20fb7f7","Type":"ContainerStarted","Data":"9e02494bd52e4690b2eaad16685849116262d2e7959e9c30afa14d9d9addd804"}
Sep 11 13:14:38.042027 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:38.041663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq" event={"ID":"75bee133-a804-48c6-85dc-60fcd20fb7f7","Type":"ContainerStarted","Data":"0316f48c38fbd1b5c05c331a741f8941b9ac4001b7cd8d64cb2676981d5f75de"}
Sep 11 13:14:38.059166 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:38.059117    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq" podStartSLOduration=2.059101072 podStartE2EDuration="2.059101072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:38.0570481 +0000 UTC m=+1642.436574027" watchObservedRunningTime="2026-09-11 13:14:38.059101072 +0000 UTC m=+1642.438627028"
Sep 11 13:14:39.048406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:39.048372    2572 generic.go:356] "Generic (PLEG): container finished" podID="75bee133-a804-48c6-85dc-60fcd20fb7f7" containerID="9e02494bd52e4690b2eaad16685849116262d2e7959e9c30afa14d9d9addd804" exitCode=0
Sep 11 13:14:39.048781 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:39.048445    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq" event={"ID":"75bee133-a804-48c6-85dc-60fcd20fb7f7","Type":"ContainerDied","Data":"9e02494bd52e4690b2eaad16685849116262d2e7959e9c30afa14d9d9addd804"}
Sep 11 13:14:40.193017 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:40.192995    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"
Sep 11 13:14:40.290513 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:40.290481    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75bee133-a804-48c6-85dc-60fcd20fb7f7-maas-api-service-ca\") pod \"75bee133-a804-48c6-85dc-60fcd20fb7f7\" (UID: \"75bee133-a804-48c6-85dc-60fcd20fb7f7\") "
Sep 11 13:14:40.290853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:40.290832    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75bee133-a804-48c6-85dc-60fcd20fb7f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "75bee133-a804-48c6-85dc-60fcd20fb7f7" (UID: "75bee133-a804-48c6-85dc-60fcd20fb7f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:40.392075 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:40.392000    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75bee133-a804-48c6-85dc-60fcd20fb7f7-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:41.061687 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:41.061654    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq" event={"ID":"75bee133-a804-48c6-85dc-60fcd20fb7f7","Type":"ContainerDied","Data":"0316f48c38fbd1b5c05c331a741f8941b9ac4001b7cd8d64cb2676981d5f75de"}
Sep 11 13:14:41.061865 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:41.061700    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0316f48c38fbd1b5c05c331a741f8941b9ac4001b7cd8d64cb2676981d5f75de"
Sep 11 13:14:41.061865 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:41.061661    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"
Sep 11 13:14:41.871052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:41.871031    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:14:42.007240 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007204    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-certs\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007253    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfwmp\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-kube-api-access-gfwmp\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007350    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-token\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007375    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-envoy\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007427    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-credential-socket\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007680 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007453    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-socket\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007680 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007491    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:42.007680 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007519    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-podinfo\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007680 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007544    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istiod-ca-cert\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007680 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007572    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-data\") pod \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\" (UID: \"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1\") "
Sep 11 13:14:42.007933 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007723    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:42.007933 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007912    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:42.008036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007937    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.008036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007957    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.008036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.007963    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:42.008165 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.008076    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:42.009737 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.009714    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:42.009853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.009738    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-kube-api-access-gfwmp" (OuterVolumeSpecName: "kube-api-access-gfwmp") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "kube-api-access-gfwmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:42.010081 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.010061    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:14:42.010146 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.010072    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" (UID: "99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:42.068310 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.068275    2572 generic.go:356] "Generic (PLEG): container finished" podID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerID="b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771" exitCode=0
Sep 11 13:14:42.068533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.068353    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"
Sep 11 13:14:42.068533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.068368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" event={"ID":"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1","Type":"ContainerDied","Data":"b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771"}
Sep 11 13:14:42.068533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.068434    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t" event={"ID":"99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1","Type":"ContainerDied","Data":"ba807901ee49e91a0238ddbc6de8bdf85b7ea3c2f0b019a52c315caf4ad8d5a7"}
Sep 11 13:14:42.068533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.068467    2572 scope.go:117] "RemoveContainer" containerID="b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771"
Sep 11 13:14:42.078204 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.078187    2572 scope.go:117] "RemoveContainer" containerID="d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604"
Sep 11 13:14:42.086507 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.086486    2572 scope.go:117] "RemoveContainer" containerID="b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771"
Sep 11 13:14:42.086772 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:42.086754    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771\": container with ID starting with b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771 not found: ID does not exist" containerID="b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771"
Sep 11 13:14:42.086820 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.086782    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771"} err="failed to get container status \"b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771\": rpc error: code = NotFound desc = could not find container \"b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771\": container with ID starting with b88a363e38586aae9e456d15aa925ee890e750c146acb52d7ccd5a638bd61771 not found: ID does not exist"
Sep 11 13:14:42.086820 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.086800    2572 scope.go:117] "RemoveContainer" containerID="d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604"
Sep 11 13:14:42.087070 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:42.087049    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604\": container with ID starting with d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604 not found: ID does not exist" containerID="d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604"
Sep 11 13:14:42.087112 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.087077    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604"} err="failed to get container status \"d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604\": rpc error: code = NotFound desc = could not find container \"d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604\": container with ID starting with d3b2d64dd990289352e6774a7b8c9fa659b092d97134ff37b522df6832e98604 not found: ID does not exist"
Sep 11 13:14:42.091141 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.091120    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"]
Sep 11 13:14:42.096687 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.096668    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ccae06-openshift-default-7846765494-pj52t"]
Sep 11 13:14:42.108883 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.108866    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.108954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.108886    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.108954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.108895    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.108954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.108904    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.108954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.108913    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.108954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.108921    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.108954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.108929    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfwmp\" (UniqueName: \"kubernetes.io/projected/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1-kube-api-access-gfwmp\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:42.139823 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.139798    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" path="/var/lib/kubelet/pods/99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1/volumes"
Sep 11 13:14:42.951249 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951221    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-50dada"]
Sep 11 13:14:42.951737 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951721    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy"
Sep 11 13:14:42.951794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951739    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy"
Sep 11 13:14:42.951794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951747    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75bee133-a804-48c6-85dc-60fcd20fb7f7" containerName="revoke-keys"
Sep 11 13:14:42.951794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951752    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="75bee133-a804-48c6-85dc-60fcd20fb7f7" containerName="revoke-keys"
Sep 11 13:14:42.951941 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951826    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy"
Sep 11 13:14:42.951941 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951835    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="04ca6d6b-f5a6-4b93-b241-e2e46a74930c" containerName="istio-proxy"
Sep 11 13:14:42.951941 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.951844    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="75bee133-a804-48c6-85dc-60fcd20fb7f7" containerName="revoke-keys"
Sep 11 13:14:42.956235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.956216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:42.961518 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.961462    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-52h42\""
Sep 11 13:14:42.964097 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:42.964075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-50dada"]
Sep 11 13:14:43.117902 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:43.117870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/fa840cd9-c487-4440-8f02-8eb19a8954b7-kube-api-access-fs4lv\") pod \"test-curl-7797-50dada\" (UID: \"fa840cd9-c487-4440-8f02-8eb19a8954b7\") " pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:43.218936 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:43.218850    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/fa840cd9-c487-4440-8f02-8eb19a8954b7-kube-api-access-fs4lv\") pod \"test-curl-7797-50dada\" (UID: \"fa840cd9-c487-4440-8f02-8eb19a8954b7\") " pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:43.227026 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:43.226999    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/fa840cd9-c487-4440-8f02-8eb19a8954b7-kube-api-access-fs4lv\") pod \"test-curl-7797-50dada\" (UID: \"fa840cd9-c487-4440-8f02-8eb19a8954b7\") " pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:43.266841 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:43.266818    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:43.534474 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:43.534270    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-50dada"]
Sep 11 13:14:43.536504 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:14:43.536478    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa840cd9_c487_4440_8f02_8eb19a8954b7.slice/crio-8d0c3d7843d9549c848f24436e3b984d885bb9f268e2ca1a44d50523411fc59a WatchSource:0}: Error finding container 8d0c3d7843d9549c848f24436e3b984d885bb9f268e2ca1a44d50523411fc59a: Status 404 returned error can't find the container with id 8d0c3d7843d9549c848f24436e3b984d885bb9f268e2ca1a44d50523411fc59a
Sep 11 13:14:44.086531 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.086487    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-50dada" event={"ID":"fa840cd9-c487-4440-8f02-8eb19a8954b7","Type":"ContainerStarted","Data":"cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078"}
Sep 11 13:14:44.086531 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.086538    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-50dada" event={"ID":"fa840cd9-c487-4440-8f02-8eb19a8954b7","Type":"ContainerStarted","Data":"8d0c3d7843d9549c848f24436e3b984d885bb9f268e2ca1a44d50523411fc59a"}
Sep 11 13:14:44.100867 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.100821    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7797-50dada" podStartSLOduration=2.100807258 podStartE2EDuration="2.100807258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:44.09912592 +0000 UTC m=+1648.478651856" watchObservedRunningTime="2026-09-11 13:14:44.100807258 +0000 UTC m=+1648.480333194"
Sep 11 13:14:44.720180 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.720144    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-50dada"]
Sep 11 13:14:44.723618 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.723590    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-50dada"]
Sep 11 13:14:44.847795 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.847720    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-d7e26b"]
Sep 11 13:14:44.848104 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.848092    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" containerName="test-curl-7797-50dada"
Sep 11 13:14:44.848145 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.848106    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" containerName="test-curl-7797-50dada"
Sep 11 13:14:44.848145 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.848114    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy"
Sep 11 13:14:44.848145 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.848121    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy"
Sep 11 13:14:44.848246 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.848185    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="99e3b1a7-b15d-4926-9ed1-e0d9f58c4dc1" containerName="istio-proxy"
Sep 11 13:14:44.848246 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.848194    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" containerName="test-curl-7797-50dada"
Sep 11 13:14:44.851463 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.851441    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:44.858871 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.858848    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-d7e26b"]
Sep 11 13:14:44.937657 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:44.937626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxv6c\" (UniqueName: \"kubernetes.io/projected/ce595e96-95cf-42a1-8d50-cb8d0735a0e3-kube-api-access-jxv6c\") pod \"test-curl-7797-d7e26b\" (UID: \"ce595e96-95cf-42a1-8d50-cb8d0735a0e3\") " pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:45.038804 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:45.038766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxv6c\" (UniqueName: \"kubernetes.io/projected/ce595e96-95cf-42a1-8d50-cb8d0735a0e3-kube-api-access-jxv6c\") pod \"test-curl-7797-d7e26b\" (UID: \"ce595e96-95cf-42a1-8d50-cb8d0735a0e3\") " pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:45.047543 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:45.047518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxv6c\" (UniqueName: \"kubernetes.io/projected/ce595e96-95cf-42a1-8d50-cb8d0735a0e3-kube-api-access-jxv6c\") pod \"test-curl-7797-d7e26b\" (UID: \"ce595e96-95cf-42a1-8d50-cb8d0735a0e3\") " pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:45.091619 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:45.091591    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7797-50dada" container="test-curl-7797-50dada"
Sep 11 13:14:45.162832 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:45.162807    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:45.430753 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:45.430728    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-d7e26b"]
Sep 11 13:14:45.433200 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:14:45.433171    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce595e96_95cf_42a1_8d50_cb8d0735a0e3.slice/crio-ffc988826fd7163ffd53e06210418466cc7c8293c65c66fbb3d65d8a416ff1e1 WatchSource:0}: Error finding container ffc988826fd7163ffd53e06210418466cc7c8293c65c66fbb3d65d8a416ff1e1: Status 404 returned error can't find the container with id ffc988826fd7163ffd53e06210418466cc7c8293c65c66fbb3d65d8a416ff1e1
Sep 11 13:14:46.098023 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:46.097985    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-d7e26b" event={"ID":"ce595e96-95cf-42a1-8d50-cb8d0735a0e3","Type":"ContainerStarted","Data":"c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf"}
Sep 11 13:14:46.098023 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:46.098030    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-d7e26b" event={"ID":"ce595e96-95cf-42a1-8d50-cb8d0735a0e3","Type":"ContainerStarted","Data":"ffc988826fd7163ffd53e06210418466cc7c8293c65c66fbb3d65d8a416ff1e1"}
Sep 11 13:14:46.098505 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:46.098118    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7797-50dada" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" containerName="test-curl-7797-50dada" containerID="cri-o://cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078" gracePeriod=2
Sep 11 13:14:46.099871 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:46.099848    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-50dada\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:46.116750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:46.116690    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7797-d7e26b" podStartSLOduration=2.116674933 podStartE2EDuration="2.116674933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:46.114865638 +0000 UTC m=+1650.494391575" watchObservedRunningTime="2026-09-11 13:14:46.116674933 +0000 UTC m=+1650.496200869"
Sep 11 13:14:46.116885 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:46.116823    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-50dada\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:46.137770 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:46.137739    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-50dada\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:46.775160 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:46.775069    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-d7e26b"]
Sep 11 13:14:46.778044 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:46.778011    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-d7e26b"]
Sep 11 13:14:47.103550 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:47.103463    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7797-d7e26b" container="test-curl-7797-d7e26b"
Sep 11 13:14:47.681558 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:47.681525    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"]
Sep 11 13:14:47.681770 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:47.681744    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9" podUID="82048c1a-1784-46de-b36d-55bc8bb8cf7c" containerName="payload-pre-processing" containerID="cri-o://eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be" gracePeriod=30
Sep 11 13:14:47.919119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:47.919087    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"]
Sep 11 13:14:47.923191 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:47.923166    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b81d9e-gz9vq"]
Sep 11 13:14:47.947609 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:47.947582    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:14:48.068755 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.068717    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jjsp\" (UniqueName: \"kubernetes.io/projected/82048c1a-1784-46de-b36d-55bc8bb8cf7c-kube-api-access-5jjsp\") pod \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") "
Sep 11 13:14:48.068912 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.068780    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82048c1a-1784-46de-b36d-55bc8bb8cf7c-plugins-config-volume\") pod \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\" (UID: \"82048c1a-1784-46de-b36d-55bc8bb8cf7c\") "
Sep 11 13:14:48.069214 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.069191    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82048c1a-1784-46de-b36d-55bc8bb8cf7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82048c1a-1784-46de-b36d-55bc8bb8cf7c" (UID: "82048c1a-1784-46de-b36d-55bc8bb8cf7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:48.071088 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.071067    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82048c1a-1784-46de-b36d-55bc8bb8cf7c-kube-api-access-5jjsp" (OuterVolumeSpecName: "kube-api-access-5jjsp") pod "82048c1a-1784-46de-b36d-55bc8bb8cf7c" (UID: "82048c1a-1784-46de-b36d-55bc8bb8cf7c"). InnerVolumeSpecName "kube-api-access-5jjsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:48.110849 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.110815    2572 generic.go:356] "Generic (PLEG): container finished" podID="82048c1a-1784-46de-b36d-55bc8bb8cf7c" containerID="eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be" exitCode=0
Sep 11 13:14:48.111201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.110859    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:14:48.111201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.110907    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9" event={"ID":"82048c1a-1784-46de-b36d-55bc8bb8cf7c","Type":"ContainerDied","Data":"eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be"}
Sep 11 13:14:48.111201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.110957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9" event={"ID":"82048c1a-1784-46de-b36d-55bc8bb8cf7c","Type":"ContainerDied","Data":"fcd2a7fb7163fc33570738dcca9d971255d0a238693b627a19649cfca7adaa5d"}
Sep 11 13:14:48.111201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.110988    2572 scope.go:117] "RemoveContainer" containerID="eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be"
Sep 11 13:14:48.111201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.111052    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7797-d7e26b" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" containerName="test-curl-7797-d7e26b" containerID="cri-o://c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf" gracePeriod=2
Sep 11 13:14:48.113136 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:48.113102    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-d7e26b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:48.120713 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:48.120691    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-d7e26b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:48.141015 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.140991    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75bee133-a804-48c6-85dc-60fcd20fb7f7" path="/var/lib/kubelet/pods/75bee133-a804-48c6-85dc-60fcd20fb7f7/volumes"
Sep 11 13:14:48.157822 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.157792    2572 scope.go:117] "RemoveContainer" containerID="eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be"
Sep 11 13:14:48.158262 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:48.158240    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be\": container with ID starting with eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be not found: ID does not exist" containerID="eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be"
Sep 11 13:14:48.158346 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.158272    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be"} err="failed to get container status \"eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be\": rpc error: code = NotFound desc = could not find container \"eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be\": container with ID starting with eb2f27e7e602c1deca54d896fa80f52ccb9938b235e65e95479edb170b0283be not found: ID does not exist"
Sep 11 13:14:48.169817 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.169793    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jjsp\" (UniqueName: \"kubernetes.io/projected/82048c1a-1784-46de-b36d-55bc8bb8cf7c-kube-api-access-5jjsp\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:48.169817 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.169818    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82048c1a-1784-46de-b36d-55bc8bb8cf7c-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:48.222980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.222958    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:48.372365 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.372305    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/fa840cd9-c487-4440-8f02-8eb19a8954b7-kube-api-access-fs4lv\") pod \"fa840cd9-c487-4440-8f02-8eb19a8954b7\" (UID: \"fa840cd9-c487-4440-8f02-8eb19a8954b7\") "
Sep 11 13:14:48.374484 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.374464    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa840cd9-c487-4440-8f02-8eb19a8954b7-kube-api-access-fs4lv" (OuterVolumeSpecName: "kube-api-access-fs4lv") pod "fa840cd9-c487-4440-8f02-8eb19a8954b7" (UID: "fa840cd9-c487-4440-8f02-8eb19a8954b7"). InnerVolumeSpecName "kube-api-access-fs4lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:48.473351 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:48.473227    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/fa840cd9-c487-4440-8f02-8eb19a8954b7-kube-api-access-fs4lv\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:49.118406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:49.118369    2572 generic.go:356] "Generic (PLEG): container finished" podID="fa840cd9-c487-4440-8f02-8eb19a8954b7" containerID="cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078" exitCode=137
Sep 11 13:14:49.118875 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:49.118413    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:49.118875 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:49.118436    2572 scope.go:117] "RemoveContainer" containerID="cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078"
Sep 11 13:14:49.127300 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:49.127282    2572 scope.go:117] "RemoveContainer" containerID="cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078"
Sep 11 13:14:49.127583 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:49.127565    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078\": container with ID starting with cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078 not found: ID does not exist" containerID="cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078"
Sep 11 13:14:49.127636 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:49.127589    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078"} err="failed to get container status \"cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078\": rpc error: code = NotFound desc = could not find container \"cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078\": container with ID starting with cf61b5ef2ec5cffe31c689adf1f8870725e41e45149a9a0a37e6c656eefad078 not found: ID does not exist"
Sep 11 13:14:49.128388 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:49.128371    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-50dada\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" pod="opendatahub/test-curl-7797-50dada"
Sep 11 13:14:50.139473 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:50.139448    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa840cd9-c487-4440-8f02-8eb19a8954b7" path="/var/lib/kubelet/pods/fa840cd9-c487-4440-8f02-8eb19a8954b7/volumes"
Sep 11 13:14:50.288813 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:50.288783    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:50.289633 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:50.289604    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxv6c\" (UniqueName: \"kubernetes.io/projected/ce595e96-95cf-42a1-8d50-cb8d0735a0e3-kube-api-access-jxv6c\") pod \"ce595e96-95cf-42a1-8d50-cb8d0735a0e3\" (UID: \"ce595e96-95cf-42a1-8d50-cb8d0735a0e3\") "
Sep 11 13:14:50.291780 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:50.291754    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce595e96-95cf-42a1-8d50-cb8d0735a0e3-kube-api-access-jxv6c" (OuterVolumeSpecName: "kube-api-access-jxv6c") pod "ce595e96-95cf-42a1-8d50-cb8d0735a0e3" (UID: "ce595e96-95cf-42a1-8d50-cb8d0735a0e3"). InnerVolumeSpecName "kube-api-access-jxv6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:50.390441 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:50.390348    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxv6c\" (UniqueName: \"kubernetes.io/projected/ce595e96-95cf-42a1-8d50-cb8d0735a0e3-kube-api-access-jxv6c\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:51.130919 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:51.130881    2572 generic.go:356] "Generic (PLEG): container finished" podID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" containerID="c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf" exitCode=137
Sep 11 13:14:51.130919 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:51.130917    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:51.131147 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:51.130978    2572 scope.go:117] "RemoveContainer" containerID="c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf"
Sep 11 13:14:51.139750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:51.139733    2572 scope.go:117] "RemoveContainer" containerID="c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf"
Sep 11 13:14:51.140017 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:51.139997    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf\": container with ID starting with c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf not found: ID does not exist" containerID="c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf"
Sep 11 13:14:51.140064 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:51.140025    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf"} err="failed to get container status \"c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf\": rpc error: code = NotFound desc = could not find container \"c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf\": container with ID starting with c3a040f94e7af19421749381600d2875ee27247414460f1ecb4d953d18e202cf not found: ID does not exist"
Sep 11 13:14:51.140400 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:14:51.140381    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-d7e26b\" is forbidden: User \"system:node:ip-10-0-136-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-247.ec2.internal' and this object" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" pod="opendatahub/test-curl-7797-d7e26b"
Sep 11 13:14:52.138962 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:52.138933    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" path="/var/lib/kubelet/pods/ce595e96-95cf-42a1-8d50-cb8d0735a0e3/volumes"
Sep 11 13:14:55.056881 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.056851    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"]
Sep 11 13:14:55.057280 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.057064    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy" containerID="cri-o://226c73286969cbb3020996bdfcefe8e5d2d7a725f503f3e0d0175776904d6603" gracePeriod=30
Sep 11 13:14:55.457759 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.457723    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"]
Sep 11 13:14:55.458086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.458074    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" containerName="test-curl-7797-d7e26b"
Sep 11 13:14:55.458133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.458088    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" containerName="test-curl-7797-d7e26b"
Sep 11 13:14:55.458133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.458111    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82048c1a-1784-46de-b36d-55bc8bb8cf7c" containerName="payload-pre-processing"
Sep 11 13:14:55.458133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.458116    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="82048c1a-1784-46de-b36d-55bc8bb8cf7c" containerName="payload-pre-processing"
Sep 11 13:14:55.458233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.458172    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="82048c1a-1784-46de-b36d-55bc8bb8cf7c" containerName="payload-pre-processing"
Sep 11 13:14:55.458233 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.458181    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce595e96-95cf-42a1-8d50-cb8d0735a0e3" containerName="test-curl-7797-d7e26b"
Sep 11 13:14:55.462641 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.462620    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"
Sep 11 13:14:55.464914 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.464894    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:14:55.465002 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.464964    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:14:55.471470 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.471446    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"]
Sep 11 13:14:55.528850 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.528816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/054f2b3a-d974-433e-ae70-e8af0632d6c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r\" (UID: \"054f2b3a-d974-433e-ae70-e8af0632d6c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"
Sep 11 13:14:55.610385 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.610308    2572 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:14:55.610551 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.610421    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:14:55.629496 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.629461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/054f2b3a-d974-433e-ae70-e8af0632d6c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r\" (UID: \"054f2b3a-d974-433e-ae70-e8af0632d6c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"
Sep 11 13:14:55.630075 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.630056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/054f2b3a-d974-433e-ae70-e8af0632d6c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r\" (UID: \"054f2b3a-d974-433e-ae70-e8af0632d6c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"
Sep 11 13:14:55.774613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:55.774527    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"
Sep 11 13:14:56.049382 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:56.049356    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"]
Sep 11 13:14:56.050663 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:14:56.050628    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054f2b3a_d974_433e_ae70_e8af0632d6c6.slice/crio-16cba6b7dd5fd0b58110947c526e36ccab764aca76c9997ff09b8b2758109322 WatchSource:0}: Error finding container 16cba6b7dd5fd0b58110947c526e36ccab764aca76c9997ff09b8b2758109322: Status 404 returned error can't find the container with id 16cba6b7dd5fd0b58110947c526e36ccab764aca76c9997ff09b8b2758109322
Sep 11 13:14:56.159979 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:56.159950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r" event={"ID":"054f2b3a-d974-433e-ae70-e8af0632d6c6","Type":"ContainerStarted","Data":"16cba6b7dd5fd0b58110947c526e36ccab764aca76c9997ff09b8b2758109322"}
Sep 11 13:14:57.166211 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:57.166179    2572 generic.go:356] "Generic (PLEG): container finished" podID="054f2b3a-d974-433e-ae70-e8af0632d6c6" containerID="f8317e3b846fdc4d3010fde5d0c2aed3718b4e0d31c7fe203c662d31110a411a" exitCode=0
Sep 11 13:14:57.166611 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:57.166269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r" event={"ID":"054f2b3a-d974-433e-ae70-e8af0632d6c6","Type":"ContainerDied","Data":"f8317e3b846fdc4d3010fde5d0c2aed3718b4e0d31c7fe203c662d31110a411a"}
Sep 11 13:14:58.299099 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.299077    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"
Sep 11 13:14:58.353002 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.352973    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/054f2b3a-d974-433e-ae70-e8af0632d6c6-maas-api-service-ca\") pod \"054f2b3a-d974-433e-ae70-e8af0632d6c6\" (UID: \"054f2b3a-d974-433e-ae70-e8af0632d6c6\") "
Sep 11 13:14:58.353354 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.353305    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/054f2b3a-d974-433e-ae70-e8af0632d6c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "054f2b3a-d974-433e-ae70-e8af0632d6c6" (UID: "054f2b3a-d974-433e-ae70-e8af0632d6c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:58.405041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.405001    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"]
Sep 11 13:14:58.405448 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.405432    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054f2b3a-d974-433e-ae70-e8af0632d6c6" containerName="revoke-keys"
Sep 11 13:14:58.405448 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.405448    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="054f2b3a-d974-433e-ae70-e8af0632d6c6" containerName="revoke-keys"
Sep 11 13:14:58.405608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.405520    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="054f2b3a-d974-433e-ae70-e8af0632d6c6" containerName="revoke-keys"
Sep 11 13:14:58.408620 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.408602    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.411140 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.411116    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"rate-test-model-d4b0b9-kserve-self-signed-certs\""
Sep 11 13:14:58.411284 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.411264    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"kube-root-ca.crt\""
Sep 11 13:14:58.411370 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.411291    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"openshift-service-ca.crt\""
Sep 11 13:14:58.411471 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.411451    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d4b0b9\"/\"default-dockercfg-9rsc5\""
Sep 11 13:14:58.417821 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.417799    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"]
Sep 11 13:14:58.454394 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.454273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-model-cache\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.454394 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.454353    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26szh\" (UniqueName: \"kubernetes.io/projected/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-kube-api-access-26szh\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.454394 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.454382    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tls-certs\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.454655 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.454402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tmp-dir\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.454655 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.454423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-home\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.454655 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.454501    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-dshm\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.454655 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.454594    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/054f2b3a-d974-433e-ae70-e8af0632d6c6-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:14:58.555794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.555752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26szh\" (UniqueName: \"kubernetes.io/projected/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-kube-api-access-26szh\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.555794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.555794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tls-certs\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.556044 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.555816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tmp-dir\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.556044 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.555929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-home\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.556044 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.555991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-dshm\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.556198 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.556053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-model-cache\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.556308 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.556290    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tmp-dir\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.556439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.556368    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-home\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.556439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.556415    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-model-cache\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.558366 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.558310    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-dshm\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.558552 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.558537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tls-certs\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.567359 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.567312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26szh\" (UniqueName: \"kubernetes.io/projected/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-kube-api-access-26szh\") pod \"rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") " pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.719120 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.719027    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:14:58.997716 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:58.997690    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"]
Sep 11 13:14:59.000276 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:14:59.000249    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b66b287_f2fe_4a90_9a27_9a3f4abe6ea6.slice/crio-de30f4b8828442ff9ed111d9dc6ba64635db7d4692d5f865737537558b86ec07 WatchSource:0}: Error finding container de30f4b8828442ff9ed111d9dc6ba64635db7d4692d5f865737537558b86ec07: Status 404 returned error can't find the container with id de30f4b8828442ff9ed111d9dc6ba64635db7d4692d5f865737537558b86ec07
Sep 11 13:14:59.178523 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:59.178491    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"
Sep 11 13:14:59.178523 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:59.178504    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r" event={"ID":"054f2b3a-d974-433e-ae70-e8af0632d6c6","Type":"ContainerDied","Data":"16cba6b7dd5fd0b58110947c526e36ccab764aca76c9997ff09b8b2758109322"}
Sep 11 13:14:59.178793 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:59.178551    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16cba6b7dd5fd0b58110947c526e36ccab764aca76c9997ff09b8b2758109322"
Sep 11 13:14:59.180155 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:59.180131    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl" event={"ID":"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6","Type":"ContainerStarted","Data":"ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce"}
Sep 11 13:14:59.180289 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:59.180160    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl" event={"ID":"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6","Type":"ContainerStarted","Data":"de30f4b8828442ff9ed111d9dc6ba64635db7d4692d5f865737537558b86ec07"}
Sep 11 13:14:59.198949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:14:59.198905    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl" podStartSLOduration=1.198890981 podStartE2EDuration="1.198890981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:59.197965483 +0000 UTC m=+1663.577491423" watchObservedRunningTime="2026-09-11 13:14:59.198890981 +0000 UTC m=+1663.578416916"
Sep 11 13:15:00.187981 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.187952    2572 generic.go:356] "Generic (PLEG): container finished" podID="768ef621-cad2-4398-a7ab-ec72f324529f" containerID="226c73286969cbb3020996bdfcefe8e5d2d7a725f503f3e0d0175776904d6603" exitCode=0
Sep 11 13:15:00.188433 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.188019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" event={"ID":"768ef621-cad2-4398-a7ab-ec72f324529f","Type":"ContainerDied","Data":"226c73286969cbb3020996bdfcefe8e5d2d7a725f503f3e0d0175776904d6603"}
Sep 11 13:15:00.188433 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.188078    2572 scope.go:117] "RemoveContainer" containerID="b6caeb2a36224c43047f3f7497e824513142cc631a0d1af583298f4271c5835f"
Sep 11 13:15:00.213554 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.213525    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"]
Sep 11 13:15:00.218007 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.217986    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"
Sep 11 13:15:00.231513 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.231484    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:15:00.238505 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.238472    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"
Sep 11 13:15:00.266946 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.266855    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"]
Sep 11 13:15:00.273124 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.273096    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"]
Sep 11 13:15:00.278963 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.278941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"
Sep 11 13:15:00.326486 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.326393    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"]
Sep 11 13:15:00.337121 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.337083    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"
Sep 11 13:15:00.349995 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.349140    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375220    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-socket\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375267    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-certs\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375310    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768ef621-cad2-4398-a7ab-ec72f324529f-istiod-ca-cert\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375395    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-credential-socket\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375435    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9psnl\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-kube-api-access-9psnl\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375464    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-istio-token\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375562    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-data\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375605    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-envoy\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.376235 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.375632    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768ef621-cad2-4398-a7ab-ec72f324529f-istio-podinfo\") pod \"768ef621-cad2-4398-a7ab-ec72f324529f\" (UID: \"768ef621-cad2-4398-a7ab-ec72f324529f\") "
Sep 11 13:15:00.377890 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.377386    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:00.377890 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.377587    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:00.377890 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.377861    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768ef621-cad2-4398-a7ab-ec72f324529f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:15:00.378088 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.377971    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-data" (OuterVolumeSpecName: "istio-data") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:00.378490 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.378470    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:00.384492 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.384419    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:15:00.393423 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.393379    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-istio-token" (OuterVolumeSpecName: "istio-token") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:00.393662 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.393610    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-kube-api-access-9psnl" (OuterVolumeSpecName: "kube-api-access-9psnl") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "kube-api-access-9psnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:00.393746 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.393693    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/768ef621-cad2-4398-a7ab-ec72f324529f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "768ef621-cad2-4398-a7ab-ec72f324529f" (UID: "768ef621-cad2-4398-a7ab-ec72f324529f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:15:00.476885 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476849    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.476885 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476885    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768ef621-cad2-4398-a7ab-ec72f324529f-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.477069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476899    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.477069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476913    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9psnl\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-kube-api-access-9psnl\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.477069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476926    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768ef621-cad2-4398-a7ab-ec72f324529f-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.477069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476939    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.477069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476950    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.477069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476962    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768ef621-cad2-4398-a7ab-ec72f324529f-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.477069 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.476974    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768ef621-cad2-4398-a7ab-ec72f324529f-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:00.561574 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.561529    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"]
Sep 11 13:15:00.563710 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:15:00.563687    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d91e5d_0a03_4267_b3c9_651fc9b27521.slice/crio-d3e41a5109b61af852ad5c30d861ab4924139fc90b27596a4b2e8d789b511d5d WatchSource:0}: Error finding container d3e41a5109b61af852ad5c30d861ab4924139fc90b27596a4b2e8d789b511d5d: Status 404 returned error can't find the container with id d3e41a5109b61af852ad5c30d861ab4924139fc90b27596a4b2e8d789b511d5d
Sep 11 13:15:00.637608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:00.637418    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"]
Sep 11 13:15:00.639742 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:15:00.639717    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc07307_c642_4183_971d_38c3805e4bbb.slice/crio-73e63ed3dac13a1c96f7a8d9ece05d9ba82a8ec33340f820c873233b67019ba3 WatchSource:0}: Error finding container 73e63ed3dac13a1c96f7a8d9ece05d9ba82a8ec33340f820c873233b67019ba3: Status 404 returned error can't find the container with id 73e63ed3dac13a1c96f7a8d9ece05d9ba82a8ec33340f820c873233b67019ba3
Sep 11 13:15:01.195615 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.195586    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"
Sep 11 13:15:01.195615 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.195596    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl" event={"ID":"768ef621-cad2-4398-a7ab-ec72f324529f","Type":"ContainerDied","Data":"9eb9fad7a109274dd5380708dc1e65a3287fdc806dab972d6689e4641e2e94dd"}
Sep 11 13:15:01.196144 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.195647    2572 scope.go:117] "RemoveContainer" containerID="226c73286969cbb3020996bdfcefe8e5d2d7a725f503f3e0d0175776904d6603"
Sep 11 13:15:01.197386 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.197202    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h" event={"ID":"6dc07307-c642-4183-971d-38c3805e4bbb","Type":"ContainerStarted","Data":"163aadf9bf38e958d6a4fcac749a043f87e4f4b8be49283faf061e373c412467"}
Sep 11 13:15:01.197386 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.197253    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h" event={"ID":"6dc07307-c642-4183-971d-38c3805e4bbb","Type":"ContainerStarted","Data":"73e63ed3dac13a1c96f7a8d9ece05d9ba82a8ec33340f820c873233b67019ba3"}
Sep 11 13:15:01.198972 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.198940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45" event={"ID":"97d91e5d-0a03-4267-b3c9-651fc9b27521","Type":"ContainerStarted","Data":"3260ed7fedc9d19902f0e5642a7c41d18eb7487d4e32d48ed3c88f8306493ef9"}
Sep 11 13:15:01.199077 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.198995    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45" event={"ID":"97d91e5d-0a03-4267-b3c9-651fc9b27521","Type":"ContainerStarted","Data":"d3e41a5109b61af852ad5c30d861ab4924139fc90b27596a4b2e8d789b511d5d"}
Sep 11 13:15:01.216512 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.216456    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45" podStartSLOduration=1.216440636 podStartE2EDuration="1.216440636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.214098156 +0000 UTC m=+1665.593624091" watchObservedRunningTime="2026-09-11 13:15:01.216440636 +0000 UTC m=+1665.595966572"
Sep 11 13:15:01.231892 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.231849    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h" podStartSLOduration=1.231832583 podStartE2EDuration="1.231832583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.230301561 +0000 UTC m=+1665.609827497" watchObservedRunningTime="2026-09-11 13:15:01.231832583 +0000 UTC m=+1665.611358519"
Sep 11 13:15:01.244623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.244594    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"]
Sep 11 13:15:01.249816 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:01.249790    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b81d9e-openshift-default-6f74cdc77b-mbvpl"]
Sep 11 13:15:02.140468 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:02.140438    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" path="/var/lib/kubelet/pods/768ef621-cad2-4398-a7ab-ec72f324529f/volumes"
Sep 11 13:15:02.207165 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:02.207129    2572 generic.go:356] "Generic (PLEG): container finished" podID="6dc07307-c642-4183-971d-38c3805e4bbb" containerID="163aadf9bf38e958d6a4fcac749a043f87e4f4b8be49283faf061e373c412467" exitCode=0
Sep 11 13:15:02.207578 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:02.207199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h" event={"ID":"6dc07307-c642-4183-971d-38c3805e4bbb","Type":"ContainerDied","Data":"163aadf9bf38e958d6a4fcac749a043f87e4f4b8be49283faf061e373c412467"}
Sep 11 13:15:02.208739 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:02.208715    2572 generic.go:356] "Generic (PLEG): container finished" podID="97d91e5d-0a03-4267-b3c9-651fc9b27521" containerID="3260ed7fedc9d19902f0e5642a7c41d18eb7487d4e32d48ed3c88f8306493ef9" exitCode=0
Sep 11 13:15:02.208837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:02.208791    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45" event={"ID":"97d91e5d-0a03-4267-b3c9-651fc9b27521","Type":"ContainerDied","Data":"3260ed7fedc9d19902f0e5642a7c41d18eb7487d4e32d48ed3c88f8306493ef9"}
Sep 11 13:15:03.357288 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:03.357263    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"
Sep 11 13:15:03.393672 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:03.393644    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"
Sep 11 13:15:04.220103 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:04.220074    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"
Sep 11 13:15:04.220295 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:04.220074    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h" event={"ID":"6dc07307-c642-4183-971d-38c3805e4bbb","Type":"ContainerDied","Data":"73e63ed3dac13a1c96f7a8d9ece05d9ba82a8ec33340f820c873233b67019ba3"}
Sep 11 13:15:04.220295 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:04.220198    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73e63ed3dac13a1c96f7a8d9ece05d9ba82a8ec33340f820c873233b67019ba3"
Sep 11 13:15:04.221603 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:04.221579    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"
Sep 11 13:15:04.221726 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:04.221629    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45" event={"ID":"97d91e5d-0a03-4267-b3c9-651fc9b27521","Type":"ContainerDied","Data":"d3e41a5109b61af852ad5c30d861ab4924139fc90b27596a4b2e8d789b511d5d"}
Sep 11 13:15:04.221726 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:04.221676    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3e41a5109b61af852ad5c30d861ab4924139fc90b27596a4b2e8d789b511d5d"
Sep 11 13:15:06.542081 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:06.542038    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"]
Sep 11 13:15:06.549397 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:06.549369    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7c542a-29818875-kpf45"]
Sep 11 13:15:06.686378 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:06.686334    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"]
Sep 11 13:15:06.686579 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:06.686551    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s" podUID="690a47b8-3ce0-494d-b729-29e3bc9f46a3" containerName="payload-pre-processing" containerID="cri-o://99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da" gracePeriod=30
Sep 11 13:15:06.957761 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:06.957734    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:15:07.033574 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.033541    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdjl6\" (UniqueName: \"kubernetes.io/projected/690a47b8-3ce0-494d-b729-29e3bc9f46a3-kube-api-access-wdjl6\") pod \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") "
Sep 11 13:15:07.033745 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.033603    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690a47b8-3ce0-494d-b729-29e3bc9f46a3-plugins-config-volume\") pod \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\" (UID: \"690a47b8-3ce0-494d-b729-29e3bc9f46a3\") "
Sep 11 13:15:07.034007 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.033981    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690a47b8-3ce0-494d-b729-29e3bc9f46a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "690a47b8-3ce0-494d-b729-29e3bc9f46a3" (UID: "690a47b8-3ce0-494d-b729-29e3bc9f46a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:15:07.035871 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.035850    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690a47b8-3ce0-494d-b729-29e3bc9f46a3-kube-api-access-wdjl6" (OuterVolumeSpecName: "kube-api-access-wdjl6") pod "690a47b8-3ce0-494d-b729-29e3bc9f46a3" (UID: "690a47b8-3ce0-494d-b729-29e3bc9f46a3"). InnerVolumeSpecName "kube-api-access-wdjl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:15:07.127562 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.127479    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"]
Sep 11 13:15:07.134813 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.134788    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdjl6\" (UniqueName: \"kubernetes.io/projected/690a47b8-3ce0-494d-b729-29e3bc9f46a3-kube-api-access-wdjl6\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:07.134813 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.134809    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/690a47b8-3ce0-494d-b729-29e3bc9f46a3-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:15:07.138041 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.138014    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7c542a-xdp9r"]
Sep 11 13:15:07.245383 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.245346    2572 generic.go:356] "Generic (PLEG): container finished" podID="690a47b8-3ce0-494d-b729-29e3bc9f46a3" containerID="99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da" exitCode=0
Sep 11 13:15:07.245533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.245392    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"
Sep 11 13:15:07.245533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.245430    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s" event={"ID":"690a47b8-3ce0-494d-b729-29e3bc9f46a3","Type":"ContainerDied","Data":"99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da"}
Sep 11 13:15:07.245533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.245485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s" event={"ID":"690a47b8-3ce0-494d-b729-29e3bc9f46a3","Type":"ContainerDied","Data":"fca9074db85c4f959d7607dbe1de040cb824afbd96b226c0c68f97c9067ef734"}
Sep 11 13:15:07.245533 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.245512    2572 scope.go:117] "RemoveContainer" containerID="99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da"
Sep 11 13:15:07.254901 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.254883    2572 scope.go:117] "RemoveContainer" containerID="99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da"
Sep 11 13:15:07.255195 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:15:07.255177    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da\": container with ID starting with 99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da not found: ID does not exist" containerID="99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da"
Sep 11 13:15:07.255244 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.255204    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da"} err="failed to get container status \"99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da\": rpc error: code = NotFound desc = could not find container \"99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da\": container with ID starting with 99dda5b928289e377660c07e50395f9409762926cdfa6d6be7265c90bfb928da not found: ID does not exist"
Sep 11 13:15:07.274157 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.274127    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"]
Sep 11 13:15:07.278620 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:07.278597    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7c542a-5775c454c8-n9t7s"]
Sep 11 13:15:08.140251 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:08.140220    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054f2b3a-d974-433e-ae70-e8af0632d6c6" path="/var/lib/kubelet/pods/054f2b3a-d974-433e-ae70-e8af0632d6c6/volumes"
Sep 11 13:15:08.140842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:08.140610    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="690a47b8-3ce0-494d-b729-29e3bc9f46a3" path="/var/lib/kubelet/pods/690a47b8-3ce0-494d-b729-29e3bc9f46a3/volumes"
Sep 11 13:15:08.140842 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:08.140839    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d91e5d-0a03-4267-b3c9-651fc9b27521" path="/var/lib/kubelet/pods/97d91e5d-0a03-4267-b3c9-651fc9b27521/volumes"
Sep 11 13:15:08.719191 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:08.719152    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:15:08.719427 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:08.719244    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:15:08.732684 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:08.732660    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:15:09.268646 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:09.268622    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:15:18.153280 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:18.153242    2572 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","burstable","pod82048c1a-1784-46de-b36d-55bc8bb8cf7c"] err="unable to destroy cgroup paths for cgroup [kubepods burstable pod82048c1a-1784-46de-b36d-55bc8bb8cf7c] : Timed out while waiting for systemd to remove kubepods-burstable-pod82048c1a_1784_46de_b36d_55bc8bb8cf7c.slice"
Sep 11 13:15:18.153280 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:15:18.153279    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods burstable pod82048c1a-1784-46de-b36d-55bc8bb8cf7c] : unable to destroy cgroup paths for cgroup [kubepods burstable pod82048c1a-1784-46de-b36d-55bc8bb8cf7c] : Timed out while waiting for systemd to remove kubepods-burstable-pod82048c1a_1784_46de_b36d_55bc8bb8cf7c.slice" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9" podUID="82048c1a-1784-46de-b36d-55bc8bb8cf7c"
Sep 11 13:15:18.302206 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:18.302176    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"
Sep 11 13:15:18.339085 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:18.339047    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"]
Sep 11 13:15:18.344012 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:18.343980    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b81d9e-5686466f8-kv7h9"]
Sep 11 13:15:20.139648 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:15:20.139615    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82048c1a-1784-46de-b36d-55bc8bb8cf7c" path="/var/lib/kubelet/pods/82048c1a-1784-46de-b36d-55bc8bb8cf7c/volumes"
Sep 11 13:16:08.250675 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:08.250639    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"]
Sep 11 13:16:10.239794 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.239763    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"]
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240092    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc07307-c642-4183-971d-38c3805e4bbb" containerName="cleanup"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240102    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc07307-c642-4183-971d-38c3805e4bbb" containerName="cleanup"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240111    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d91e5d-0a03-4267-b3c9-651fc9b27521" containerName="cleanup"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240117    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d91e5d-0a03-4267-b3c9-651fc9b27521" containerName="cleanup"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240129    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690a47b8-3ce0-494d-b729-29e3bc9f46a3" containerName="payload-pre-processing"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240134    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="690a47b8-3ce0-494d-b729-29e3bc9f46a3" containerName="payload-pre-processing"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240145    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240150    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240158    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy"
Sep 11 13:16:10.240164 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240164    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy"
Sep 11 13:16:10.240508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240216    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="690a47b8-3ce0-494d-b729-29e3bc9f46a3" containerName="payload-pre-processing"
Sep 11 13:16:10.240508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240224    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d91e5d-0a03-4267-b3c9-651fc9b27521" containerName="cleanup"
Sep 11 13:16:10.240508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240231    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc07307-c642-4183-971d-38c3805e4bbb" containerName="cleanup"
Sep 11 13:16:10.240508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240237    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy"
Sep 11 13:16:10.240508 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.240242    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="768ef621-cad2-4398-a7ab-ec72f324529f" containerName="istio-proxy"
Sep 11 13:16:10.243192 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.243177    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.246872 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.246850    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-37c1cf-openshift-default-dockercfg-t44b5\""
Sep 11 13:16:10.331273 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.331239    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"]
Sep 11 13:16:10.334367 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334311    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-data\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334549 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6sb\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-kube-api-access-4b6sb\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334549 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-certs\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334549 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334444    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8708f428-a473-4205-87af-b2345a0f9ef0-istio-podinfo\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334549 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8708f428-a473-4205-87af-b2345a0f9ef0-istiod-ca-cert\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334595    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-envoy\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334645    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-socket\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-credential-socket\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.334776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.334741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-istio-token\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.435789 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.435751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-socket\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.435789 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.435787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-credential-socket\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436010 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.435836    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-istio-token\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436010 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.435868    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-data\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436010 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.435908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6sb\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-kube-api-access-4b6sb\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436010 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.435969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-certs\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436010 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.435991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8708f428-a473-4205-87af-b2345a0f9ef0-istio-podinfo\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436262 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.436028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8708f428-a473-4205-87af-b2345a0f9ef0-istiod-ca-cert\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436262 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.436071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-envoy\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436262 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.436205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-socket\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436450 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.436244    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-credential-socket\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436450 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.436291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-data\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436450 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.436411    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-certs\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.436843 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.436823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8708f428-a473-4205-87af-b2345a0f9ef0-istiod-ca-cert\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.438496 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.438474    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-envoy\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.438879 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.438853    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8708f428-a473-4205-87af-b2345a0f9ef0-istio-podinfo\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.449438 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.449410    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6sb\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-kube-api-access-4b6sb\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.450225 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.450205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-istio-token\") pod \"e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") " pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.553597 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.553503    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:10.863896 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.863804    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"]
Sep 11 13:16:10.866798 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:16:10.866768    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8708f428_a473_4205_87af_b2345a0f9ef0.slice/crio-7d266ba1a31d4e38defddf69fc489260b8769f101d1ef7a5670dda4033909ac0 WatchSource:0}: Error finding container 7d266ba1a31d4e38defddf69fc489260b8769f101d1ef7a5670dda4033909ac0: Status 404 returned error can't find the container with id 7d266ba1a31d4e38defddf69fc489260b8769f101d1ef7a5670dda4033909ac0
Sep 11 13:16:10.868972 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.868939    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:16:10.869061 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.869007    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:16:10.869061 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:10.869051    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:16:11.568246 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:11.568211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" event={"ID":"8708f428-a473-4205-87af-b2345a0f9ef0","Type":"ContainerStarted","Data":"9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8"}
Sep 11 13:16:11.568666 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:11.568269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" event={"ID":"8708f428-a473-4205-87af-b2345a0f9ef0","Type":"ContainerStarted","Data":"7d266ba1a31d4e38defddf69fc489260b8769f101d1ef7a5670dda4033909ac0"}
Sep 11 13:16:12.553816 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:12.553772    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:12.558914 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:12.558889    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:12.573633 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:12.573609    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:12.574684 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:12.574629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:12.600275 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:12.600215    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podStartSLOduration=2.6001913500000002 podStartE2EDuration="2.60019135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:16:11.610608575 +0000 UTC m=+1735.990134510" watchObservedRunningTime="2026-09-11 13:16:12.60019135 +0000 UTC m=+1736.979717291"
Sep 11 13:16:16.685499 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.685468    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"]
Sep 11 13:16:16.689240 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.689223    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:16.693402 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.693376    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-37c1cf-dockercfg-qkpwg\""
Sep 11 13:16:16.693841 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.693823    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-37c1cf\""
Sep 11 13:16:16.714124 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.714087    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"]
Sep 11 13:16:16.796701 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.796661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f520d25e-920d-492d-84e3-2b0bad55aac1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:16.796882 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.796776    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4nwz\" (UniqueName: \"kubernetes.io/projected/f520d25e-920d-492d-84e3-2b0bad55aac1-kube-api-access-n4nwz\") pod \"payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:16.897586 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.897550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4nwz\" (UniqueName: \"kubernetes.io/projected/f520d25e-920d-492d-84e3-2b0bad55aac1-kube-api-access-n4nwz\") pod \"payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:16.897757 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.897612    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f520d25e-920d-492d-84e3-2b0bad55aac1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:16.898274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.898252    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f520d25e-920d-492d-84e3-2b0bad55aac1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:16.911035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:16.911009    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4nwz\" (UniqueName: \"kubernetes.io/projected/f520d25e-920d-492d-84e3-2b0bad55aac1-kube-api-access-n4nwz\") pod \"payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:17.000109 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:17.000020    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:17.292949 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:17.292869    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"]
Sep 11 13:16:17.295339 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:16:17.295301    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf520d25e_920d_492d_84e3_2b0bad55aac1.slice/crio-bf586a6caebfc56a2362088425793bc6f25e54a3e6a53500668e34a6e6b1ba47 WatchSource:0}: Error finding container bf586a6caebfc56a2362088425793bc6f25e54a3e6a53500668e34a6e6b1ba47: Status 404 returned error can't find the container with id bf586a6caebfc56a2362088425793bc6f25e54a3e6a53500668e34a6e6b1ba47
Sep 11 13:16:17.600862 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:17.600765    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x" event={"ID":"f520d25e-920d-492d-84e3-2b0bad55aac1","Type":"ContainerStarted","Data":"a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0"}
Sep 11 13:16:17.600862 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:17.600831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x" event={"ID":"f520d25e-920d-492d-84e3-2b0bad55aac1","Type":"ContainerStarted","Data":"bf586a6caebfc56a2362088425793bc6f25e54a3e6a53500668e34a6e6b1ba47"}
Sep 11 13:16:17.600862 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:17.600860    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:17.633474 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:17.633413    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x" podStartSLOduration=1.633396688 podStartE2EDuration="1.633396688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:16:17.629895275 +0000 UTC m=+1742.009421212" watchObservedRunningTime="2026-09-11 13:16:17.633396688 +0000 UTC m=+1742.012922623"
Sep 11 13:16:23.271299 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.271259    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl" podUID="5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" containerName="main" containerID="cri-o://ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce" gracePeriod=45
Sep 11 13:16:23.561122 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.561095    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:16:23.634800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.634763    2572 generic.go:356] "Generic (PLEG): container finished" podID="5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" containerID="ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce" exitCode=0
Sep 11 13:16:23.634963 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.634813    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"
Sep 11 13:16:23.634963 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.634838    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl" event={"ID":"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6","Type":"ContainerDied","Data":"ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce"}
Sep 11 13:16:23.634963 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.634877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl" event={"ID":"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6","Type":"ContainerDied","Data":"de30f4b8828442ff9ed111d9dc6ba64635db7d4692d5f865737537558b86ec07"}
Sep 11 13:16:23.634963 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.634898    2572 scope.go:117] "RemoveContainer" containerID="ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce"
Sep 11 13:16:23.643784 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.643767    2572 scope.go:117] "RemoveContainer" containerID="ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce"
Sep 11 13:16:23.644065 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:16:23.644041    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce\": container with ID starting with ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce not found: ID does not exist" containerID="ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce"
Sep 11 13:16:23.644112 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.644065    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce"} err="failed to get container status \"ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce\": rpc error: code = NotFound desc = could not find container \"ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce\": container with ID starting with ff3fae005e393bf1a4cd28c72bcf35f6a1fa6e8b4ad4d6d1374636ff6f56b8ce not found: ID does not exist"
Sep 11 13:16:23.665435 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665405    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-dshm\") pod \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") "
Sep 11 13:16:23.665532 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665466    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-home\") pod \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") "
Sep 11 13:16:23.665532 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665507    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-model-cache\") pod \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") "
Sep 11 13:16:23.665607 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665533    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tls-certs\") pod \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") "
Sep 11 13:16:23.665607 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665553    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26szh\" (UniqueName: \"kubernetes.io/projected/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-kube-api-access-26szh\") pod \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") "
Sep 11 13:16:23.665685 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665625    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tmp-dir\") pod \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\" (UID: \"5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6\") "
Sep 11 13:16:23.665818 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665769    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" (UID: "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:23.665818 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665777    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-home" (OuterVolumeSpecName: "home") pod "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" (UID: "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:23.666031 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665892    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-home\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:16:23.666031 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665911    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-model-cache\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:16:23.666031 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.665924    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" (UID: "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:23.667633 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.667613    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-dshm" (OuterVolumeSpecName: "dshm") pod "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" (UID: "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:16:23.667780 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.667760    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-kube-api-access-26szh" (OuterVolumeSpecName: "kube-api-access-26szh") pod "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" (UID: "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6"). InnerVolumeSpecName "kube-api-access-26szh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:16:23.667823 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.667793    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" (UID: "5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:16:23.767313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.767272    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tls-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:16:23.767313 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.767306    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26szh\" (UniqueName: \"kubernetes.io/projected/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-kube-api-access-26szh\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:16:23.767617 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.767350    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-tmp-dir\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:16:23.767617 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.767366    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6-dshm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:16:23.960090 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.960052    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"]
Sep 11 13:16:23.967976 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:23.967948    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d4b0b9/rate-test-model-d4b0b9-kserve-8c5f5bc4c-vmbnl"]
Sep 11 13:16:24.139737 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:24.139707    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" path="/var/lib/kubelet/pods/5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6/volumes"
Sep 11 13:16:28.608586 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:28.608560    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:16:28.616449 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:28.616413    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:16:28.616601 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:28.616475    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:16:30.673919 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:30.673864    2572 generic.go:356] "Generic (PLEG): container finished" podID="8708f428-a473-4205-87af-b2345a0f9ef0" containerID="9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8" exitCode=0
Sep 11 13:16:30.673919 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:30.673892    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" event={"ID":"8708f428-a473-4205-87af-b2345a0f9ef0","Type":"ContainerDied","Data":"9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8"}
Sep 11 13:16:30.674504 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:30.674360    2572 scope.go:117] "RemoveContainer" containerID="9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8"
Sep 11 13:16:30.675487 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:30.675456    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:16:30.675557 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:30.675523    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:16:30.675557 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:30.675552    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:16:31.680634 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:31.680605    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" event={"ID":"8708f428-a473-4205-87af-b2345a0f9ef0","Type":"ContainerStarted","Data":"eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5"}
Sep 11 13:16:32.554632 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:32.554594    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:32.554858 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:32.554835    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 13:16:32.554907 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:32.554886    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 13:16:33.554222 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:33.554183    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 13:16:33.554669 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:33.554242    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 13:16:34.554504 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:34.554467    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 13:16:34.554898 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:34.554519    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 13:16:35.554860 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:35.554821    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 13:16:35.555263 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:35.554880    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 13:16:36.554909 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:36.554875    2572 patch_prober.go:28] interesting pod/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 13:16:36.555306 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:36.554936    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 13:16:37.558238 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:37.558204    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:37.558745 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:37.558483    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:37.559362 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:37.559346    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:16:49.933267 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.933231    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"]
Sep 11 13:16:49.933799 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.933632    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" containerName="main"
Sep 11 13:16:49.933799 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.933643    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" containerName="main"
Sep 11 13:16:49.933799 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.933715    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b66b287-f2fe-4a90-9a27-9a3f4abe6ea6" containerName="main"
Sep 11 13:16:49.936558 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.936543    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:49.941799 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.941777    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-06286a\""
Sep 11 13:16:49.999466 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.999429    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbd6\" (UniqueName: \"kubernetes.io/projected/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-kube-api-access-pdbd6\") pod \"payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:49.999632 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:49.999470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:50.002353 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.002308    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"]
Sep 11 13:16:50.005736 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.005718    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.009484 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.009462    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-06286a-dockercfg-ffxjk\""
Sep 11 13:16:50.033481 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.033456    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"]
Sep 11 13:16:50.040906 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.040883    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"]
Sep 11 13:16:50.100300 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.100250    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.100505 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.100387    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbd6\" (UniqueName: \"kubernetes.io/projected/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-kube-api-access-pdbd6\") pod \"payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:50.100505 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.100409    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:50.100505 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.100428    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnn4k\" (UniqueName: \"kubernetes.io/projected/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-kube-api-access-lnn4k\") pod \"payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.101148 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.101127    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:50.116369 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.116310    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbd6\" (UniqueName: \"kubernetes.io/projected/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-kube-api-access-pdbd6\") pod \"payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:50.201627 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.201527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnn4k\" (UniqueName: \"kubernetes.io/projected/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-kube-api-access-lnn4k\") pod \"payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.201803 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.201636    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.202307 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.202289    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.216633 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.216575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnn4k\" (UniqueName: \"kubernetes.io/projected/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-kube-api-access-lnn4k\") pod \"payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.245896 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.245868    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:50.315760 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.315735    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.523341 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.523261    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"]
Sep 11 13:16:50.525386 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:16:50.525356    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0212fcac_3731_4ae1_b078_4a9c89f5a8cc.slice/crio-d9ec7a7278f76bf1ee5ed49b07094bbd71b6283df5e0ce37d5c0d619cf777669 WatchSource:0}: Error finding container d9ec7a7278f76bf1ee5ed49b07094bbd71b6283df5e0ce37d5c0d619cf777669: Status 404 returned error can't find the container with id d9ec7a7278f76bf1ee5ed49b07094bbd71b6283df5e0ce37d5c0d619cf777669
Sep 11 13:16:50.592726 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.592707    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"]
Sep 11 13:16:50.594356 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:16:50.594328    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7e525f_d1ea_4fe0_a4ac_9eea030c26d0.slice/crio-b6791b651caa4fc324ccde558dd151abbbcf597e3a23d3cb53f31c2938fbec85 WatchSource:0}: Error finding container b6791b651caa4fc324ccde558dd151abbbcf597e3a23d3cb53f31c2938fbec85: Status 404 returned error can't find the container with id b6791b651caa4fc324ccde558dd151abbbcf597e3a23d3cb53f31c2938fbec85
Sep 11 13:16:50.788173 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.788072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt" event={"ID":"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0","Type":"ContainerStarted","Data":"5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564"}
Sep 11 13:16:50.788173 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.788138    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:16:50.788173 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.788160    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt" event={"ID":"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0","Type":"ContainerStarted","Data":"b6791b651caa4fc324ccde558dd151abbbcf597e3a23d3cb53f31c2938fbec85"}
Sep 11 13:16:50.789657 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.789625    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf" event={"ID":"0212fcac-3731-4ae1-b078-4a9c89f5a8cc","Type":"ContainerStarted","Data":"d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3"}
Sep 11 13:16:50.789774 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.789669    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf" event={"ID":"0212fcac-3731-4ae1-b078-4a9c89f5a8cc","Type":"ContainerStarted","Data":"d9ec7a7278f76bf1ee5ed49b07094bbd71b6283df5e0ce37d5c0d619cf777669"}
Sep 11 13:16:50.789774 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.789691    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:16:50.808628 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.808583    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt" podStartSLOduration=1.808568653 podStartE2EDuration="1.808568653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:16:50.80737149 +0000 UTC m=+1775.186897423" watchObservedRunningTime="2026-09-11 13:16:50.808568653 +0000 UTC m=+1775.188094589"
Sep 11 13:16:50.826157 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:16:50.826110    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf" podStartSLOduration=1.826092861 podStartE2EDuration="1.826092861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:16:50.824366153 +0000 UTC m=+1775.203892091" watchObservedRunningTime="2026-09-11 13:16:50.826092861 +0000 UTC m=+1775.205618797"
Sep 11 13:17:01.797201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:17:01.797167    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:17:01.797682 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:17:01.797240    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:17:16.184312 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:17:16.184285    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:17:16.188534 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:17:16.188510    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:17:16.445522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:17:16.445428    2572 scope.go:117] "RemoveContainer" containerID="69c31b8177eef2ae6786a3a224bcdd92deae6b078019d40229578544cdd1be46"
Sep 11 13:17:18.265379 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:17:18.265351    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf_0212fcac-3731-4ae1-b078-4a9c89f5a8cc/payload-processing/0.log"
Sep 11 13:18:01.599548 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:01.599514    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf_0212fcac-3731-4ae1-b078-4a9c89f5a8cc/payload-processing/0.log"
Sep 11 13:18:02.269172 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.269137    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"]
Sep 11 13:18:02.272244 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.272224    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.274782 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.274752    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-338b23-openshift-default-dockercfg-6dcnr\""
Sep 11 13:18:02.278475 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-envoy\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278579 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-token\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278579 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278556    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-socket\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278657 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278583    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-data\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278657 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-certs\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d6ec096-29b1-4c32-b272-6a99bb34d071-istiod-ca-cert\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278730 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-credential-socket\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278806 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tzjn\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-kube-api-access-9tzjn\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.278806 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.278780    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-podinfo\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.301002 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.300962    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"]
Sep 11 13:18:02.379529 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-socket\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.379529 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-data\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.379800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-certs\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.379800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d6ec096-29b1-4c32-b272-6a99bb34d071-istiod-ca-cert\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.379800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-credential-socket\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.379800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tzjn\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-kube-api-access-9tzjn\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.379800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-podinfo\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.379800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-envoy\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.380107 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-token\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.380107 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.379988    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-socket\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.380488 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.380337    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d6ec096-29b1-4c32-b272-6a99bb34d071-istiod-ca-cert\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.380488 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.380443    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-certs\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.380772 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.380484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-credential-socket\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.380772 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.380501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-data\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.382529 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.382504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-envoy\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.382765 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.382746    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-podinfo\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.389395 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.389363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tzjn\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-kube-api-access-9tzjn\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.392979 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.392952    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-token\") pod \"e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") " pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.583366 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.583241    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:02.874837 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.874810    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"]
Sep 11 13:18:02.877549 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:18:02.877513    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6ec096_29b1_4c32_b272_6a99bb34d071.slice/crio-815df86a7f5aaa937d56645e61efa7953e4bd6d706248aaec3d7afe3c91b8ae1 WatchSource:0}: Error finding container 815df86a7f5aaa937d56645e61efa7953e4bd6d706248aaec3d7afe3c91b8ae1: Status 404 returned error can't find the container with id 815df86a7f5aaa937d56645e61efa7953e4bd6d706248aaec3d7afe3c91b8ae1
Sep 11 13:18:02.879929 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.879886    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:18:02.880025 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.879957    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:18:02.880025 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:02.879983    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:18:03.154290 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:03.154251    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" event={"ID":"3d6ec096-29b1-4c32-b272-6a99bb34d071","Type":"ContainerStarted","Data":"f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da"}
Sep 11 13:18:03.154488 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:03.154372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" event={"ID":"3d6ec096-29b1-4c32-b272-6a99bb34d071","Type":"ContainerStarted","Data":"815df86a7f5aaa937d56645e61efa7953e4bd6d706248aaec3d7afe3c91b8ae1"}
Sep 11 13:18:03.178267 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:03.178195    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podStartSLOduration=1.178170572 podStartE2EDuration="1.178170572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:18:03.176139064 +0000 UTC m=+1847.555665001" watchObservedRunningTime="2026-09-11 13:18:03.178170572 +0000 UTC m=+1847.557696507"
Sep 11 13:18:03.584237 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:03.584141    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:03.585712 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:03.585688    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:03.585839 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:03.585753    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:04.587955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:04.587917    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:05.164565 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:05.164528    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:05.165565 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:05.165541    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:27.289792 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:27.289755    2572 generic.go:356] "Generic (PLEG): container finished" podID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerID="f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da" exitCode=0
Sep 11 13:18:27.290353 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:27.289838    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" event={"ID":"3d6ec096-29b1-4c32-b272-6a99bb34d071","Type":"ContainerDied","Data":"f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da"}
Sep 11 13:18:27.290353 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:27.290286    2572 scope.go:117] "RemoveContainer" containerID="f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da"
Sep 11 13:18:27.291590 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:27.291558    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:18:27.291708 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:27.291634    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:18:27.291708 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:27.291680    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 13:18:28.302405 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:28.302362    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" event={"ID":"3d6ec096-29b1-4c32-b272-6a99bb34d071","Type":"ContainerStarted","Data":"555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa"}
Sep 11 13:18:28.584372 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:28.584241    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:28.585793 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:28.585754    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:28.585954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:28.585831    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:29.584498 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:29.584462    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:29.585134 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:29.585095    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:30.584085 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:30.584046    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:30.584423 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:30.584384    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:30.965083 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:30.965047    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"]
Sep 11 13:18:30.967446 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:30.967429    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"
Sep 11 13:18:30.971528 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:30.971506    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:18:30.972012 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:30.971995    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:18:30.991224 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:30.991181    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"]
Sep 11 13:18:31.060378 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:31.060340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/062e48ae-cfd2-4961-8f93-f1b37a62c6f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9\" (UID: \"062e48ae-cfd2-4961-8f93-f1b37a62c6f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"
Sep 11 13:18:31.161161 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:31.161121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/062e48ae-cfd2-4961-8f93-f1b37a62c6f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9\" (UID: \"062e48ae-cfd2-4961-8f93-f1b37a62c6f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"
Sep 11 13:18:31.161758 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:31.161739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/062e48ae-cfd2-4961-8f93-f1b37a62c6f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9\" (UID: \"062e48ae-cfd2-4961-8f93-f1b37a62c6f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"
Sep 11 13:18:31.278382 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:31.278285    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"
Sep 11 13:18:31.580974 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:31.580947    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"]
Sep 11 13:18:31.582162 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:18:31.582131    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062e48ae_cfd2_4961_8f93_f1b37a62c6f2.slice/crio-2cb7bc69b8c53d43d33d0a453fa9a0b1aabf2e4e7bbd8427fbc7d9f7ac869ce7 WatchSource:0}: Error finding container 2cb7bc69b8c53d43d33d0a453fa9a0b1aabf2e4e7bbd8427fbc7d9f7ac869ce7: Status 404 returned error can't find the container with id 2cb7bc69b8c53d43d33d0a453fa9a0b1aabf2e4e7bbd8427fbc7d9f7ac869ce7
Sep 11 13:18:31.584465 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:31.584434    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:31.584568 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:31.584490    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:32.330824 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:32.330733    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9" event={"ID":"062e48ae-cfd2-4961-8f93-f1b37a62c6f2","Type":"ContainerStarted","Data":"55fd53f6c20012e9a314efb555a94ede8085034233197d467b676bbdf96e069c"}
Sep 11 13:18:32.330824 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:32.330786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9" event={"ID":"062e48ae-cfd2-4961-8f93-f1b37a62c6f2","Type":"ContainerStarted","Data":"2cb7bc69b8c53d43d33d0a453fa9a0b1aabf2e4e7bbd8427fbc7d9f7ac869ce7"}
Sep 11 13:18:32.348959 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:32.348904    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9" podStartSLOduration=2.348888535 podStartE2EDuration="2.348888535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:18:32.34695429 +0000 UTC m=+1876.726480225" watchObservedRunningTime="2026-09-11 13:18:32.348888535 +0000 UTC m=+1876.728414470"
Sep 11 13:18:32.584347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:32.584210    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:32.584347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:32.584282    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:33.338136 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:33.338102    2572 generic.go:356] "Generic (PLEG): container finished" podID="062e48ae-cfd2-4961-8f93-f1b37a62c6f2" containerID="55fd53f6c20012e9a314efb555a94ede8085034233197d467b676bbdf96e069c" exitCode=0
Sep 11 13:18:33.338573 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:33.338189    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9" event={"ID":"062e48ae-cfd2-4961-8f93-f1b37a62c6f2","Type":"ContainerDied","Data":"55fd53f6c20012e9a314efb555a94ede8085034233197d467b676bbdf96e069c"}
Sep 11 13:18:33.583667 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:33.583625    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:33.583850 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:33.583692    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:34.470036 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:34.470011    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"
Sep 11 13:18:34.588363 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:34.588312    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:34.588640 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:34.588618    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:34.589245 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:34.589226    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:34.594200 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:34.594144    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/062e48ae-cfd2-4961-8f93-f1b37a62c6f2-maas-api-service-ca\") pod \"062e48ae-cfd2-4961-8f93-f1b37a62c6f2\" (UID: \"062e48ae-cfd2-4961-8f93-f1b37a62c6f2\") "
Sep 11 13:18:34.594500 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:34.594481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/062e48ae-cfd2-4961-8f93-f1b37a62c6f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "062e48ae-cfd2-4961-8f93-f1b37a62c6f2" (UID: "062e48ae-cfd2-4961-8f93-f1b37a62c6f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:18:34.695219 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:34.695172    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/062e48ae-cfd2-4961-8f93-f1b37a62c6f2-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:35.350302 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:35.350275    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"
Sep 11 13:18:35.350515 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:35.350327    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9" event={"ID":"062e48ae-cfd2-4961-8f93-f1b37a62c6f2","Type":"ContainerDied","Data":"2cb7bc69b8c53d43d33d0a453fa9a0b1aabf2e4e7bbd8427fbc7d9f7ac869ce7"}
Sep 11 13:18:35.350515 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:35.350369    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cb7bc69b8c53d43d33d0a453fa9a0b1aabf2e4e7bbd8427fbc7d9f7ac869ce7"
Sep 11 13:18:37.458683 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:37.458650    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"]
Sep 11 13:18:37.461721 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:37.461696    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-338b23-qgfb9"]
Sep 11 13:18:38.139535 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:38.139453    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="062e48ae-cfd2-4961-8f93-f1b37a62c6f2" path="/var/lib/kubelet/pods/062e48ae-cfd2-4961-8f93-f1b37a62c6f2/volumes"
Sep 11 13:18:44.436326 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:44.436284    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"]
Sep 11 13:18:44.436739 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:44.436523    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" containerID="cri-o://555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa" gracePeriod=30
Sep 11 13:18:49.591019 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.590981    2572 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 11 13:18:49.591510 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.591052    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 11 13:18:49.696751 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.696720    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:49.744754 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.744661    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-token\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.744754 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.744699    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-podinfo\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.744754 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.744751    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-socket\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.745009 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.744813    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-certs\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.745009 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.744839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-credential-socket\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.745009 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.744881    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-data\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.745163 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745031    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d6ec096-29b1-4c32-b272-6a99bb34d071-istiod-ca-cert\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.745163 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745076    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:49.745163 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745093    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tzjn\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-kube-api-access-9tzjn\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.745163 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745108    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:49.745163 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745146    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-envoy\") pod \"3d6ec096-29b1-4c32-b272-6a99bb34d071\" (UID: \"3d6ec096-29b1-4c32-b272-6a99bb34d071\") "
Sep 11 13:18:49.745460 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745277    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:49.745460 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745303    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:49.745460 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745434    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d6ec096-29b1-4c32-b272-6a99bb34d071-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:18:49.745613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745544    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.745613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745564    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.745613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745578    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.745613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745592    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d6ec096-29b1-4c32-b272-6a99bb34d071-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.745613 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.745605    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.747418 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.747390    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:18:49.747624 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.747605    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:49.747860 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.747834    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:18:49.747860 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.747836    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-kube-api-access-9tzjn" (OuterVolumeSpecName: "kube-api-access-9tzjn") pod "3d6ec096-29b1-4c32-b272-6a99bb34d071" (UID: "3d6ec096-29b1-4c32-b272-6a99bb34d071"). InnerVolumeSpecName "kube-api-access-9tzjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:18:49.846756 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.846724    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.846756 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.846750    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.846756 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.846759    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d6ec096-29b1-4c32-b272-6a99bb34d071-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:49.846995 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:49.846768    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tzjn\" (UniqueName: \"kubernetes.io/projected/3d6ec096-29b1-4c32-b272-6a99bb34d071-kube-api-access-9tzjn\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:18:50.436396 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.436263    2572 generic.go:356] "Generic (PLEG): container finished" podID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerID="555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa" exitCode=0
Sep 11 13:18:50.436396 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.436387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" event={"ID":"3d6ec096-29b1-4c32-b272-6a99bb34d071","Type":"ContainerDied","Data":"555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa"}
Sep 11 13:18:50.436623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.436505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz" event={"ID":"3d6ec096-29b1-4c32-b272-6a99bb34d071","Type":"ContainerDied","Data":"815df86a7f5aaa937d56645e61efa7953e4bd6d706248aaec3d7afe3c91b8ae1"}
Sep 11 13:18:50.436623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.436551    2572 scope.go:117] "RemoveContainer" containerID="555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa"
Sep 11 13:18:50.436853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.436836    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"
Sep 11 13:18:50.448630 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.448607    2572 scope.go:117] "RemoveContainer" containerID="f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da"
Sep 11 13:18:50.455349 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.455298    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"]
Sep 11 13:18:50.458688 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.458668    2572 scope.go:117] "RemoveContainer" containerID="555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa"
Sep 11 13:18:50.459133 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:18:50.459107    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa\": container with ID starting with 555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa not found: ID does not exist" containerID="555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa"
Sep 11 13:18:50.459206 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.459146    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa"} err="failed to get container status \"555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa\": rpc error: code = NotFound desc = could not find container \"555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa\": container with ID starting with 555cd21a9691b32b6f303e38f9ac9adc314a92922e3a4577eea2f9290cc795fa not found: ID does not exist"
Sep 11 13:18:50.459206 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.459172    2572 scope.go:117] "RemoveContainer" containerID="f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da"
Sep 11 13:18:50.459573 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:18:50.459553    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da\": container with ID starting with f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da not found: ID does not exist" containerID="f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da"
Sep 11 13:18:50.459651 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.459578    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da"} err="failed to get container status \"f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da\": rpc error: code = NotFound desc = could not find container \"f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da\": container with ID starting with f3ab7da70ac02c280edc106085863188fc6e694543805db918dd75c236c419da not found: ID does not exist"
Sep 11 13:18:50.459651 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:50.459604    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-338b23-openshift-default-7bbf9df666-qhfxz"]
Sep 11 13:18:52.141171 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:18:52.141138    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" path="/var/lib/kubelet/pods/3d6ec096-29b1-4c32-b272-6a99bb34d071/volumes"
Sep 11 13:19:03.949221 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:03.949188    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"]
Sep 11 13:19:03.949797 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:03.949433    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x" podUID="f520d25e-920d-492d-84e3-2b0bad55aac1" containerName="payload-pre-processing" containerID="cri-o://a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0" gracePeriod=30
Sep 11 13:19:04.218098 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.218074    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:19:04.278260 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.278212    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f520d25e-920d-492d-84e3-2b0bad55aac1-plugins-config-volume\") pod \"f520d25e-920d-492d-84e3-2b0bad55aac1\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") "
Sep 11 13:19:04.278474 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.278344    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4nwz\" (UniqueName: \"kubernetes.io/projected/f520d25e-920d-492d-84e3-2b0bad55aac1-kube-api-access-n4nwz\") pod \"f520d25e-920d-492d-84e3-2b0bad55aac1\" (UID: \"f520d25e-920d-492d-84e3-2b0bad55aac1\") "
Sep 11 13:19:04.278617 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.278594    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f520d25e-920d-492d-84e3-2b0bad55aac1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f520d25e-920d-492d-84e3-2b0bad55aac1" (UID: "f520d25e-920d-492d-84e3-2b0bad55aac1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:19:04.278683 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.278670    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f520d25e-920d-492d-84e3-2b0bad55aac1-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:04.280824 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.280798    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f520d25e-920d-492d-84e3-2b0bad55aac1-kube-api-access-n4nwz" (OuterVolumeSpecName: "kube-api-access-n4nwz") pod "f520d25e-920d-492d-84e3-2b0bad55aac1" (UID: "f520d25e-920d-492d-84e3-2b0bad55aac1"). InnerVolumeSpecName "kube-api-access-n4nwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:19:04.379609 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.379572    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4nwz\" (UniqueName: \"kubernetes.io/projected/f520d25e-920d-492d-84e3-2b0bad55aac1-kube-api-access-n4nwz\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:04.517857 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.517755    2572 generic.go:356] "Generic (PLEG): container finished" podID="f520d25e-920d-492d-84e3-2b0bad55aac1" containerID="a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0" exitCode=0
Sep 11 13:19:04.517857 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.517808    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"
Sep 11 13:19:04.517857 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.517849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x" event={"ID":"f520d25e-920d-492d-84e3-2b0bad55aac1","Type":"ContainerDied","Data":"a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0"}
Sep 11 13:19:04.518135 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.517902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x" event={"ID":"f520d25e-920d-492d-84e3-2b0bad55aac1","Type":"ContainerDied","Data":"bf586a6caebfc56a2362088425793bc6f25e54a3e6a53500668e34a6e6b1ba47"}
Sep 11 13:19:04.518135 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.517927    2572 scope.go:117] "RemoveContainer" containerID="a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0"
Sep 11 13:19:04.527067 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.527051    2572 scope.go:117] "RemoveContainer" containerID="a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0"
Sep 11 13:19:04.527381 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:19:04.527359    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0\": container with ID starting with a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0 not found: ID does not exist" containerID="a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0"
Sep 11 13:19:04.527437 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.527392    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0"} err="failed to get container status \"a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0\": rpc error: code = NotFound desc = could not find container \"a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0\": container with ID starting with a8874c79df3183df49d534065e071f363742f865a392b81abc43eab3d0a5e8a0 not found: ID does not exist"
Sep 11 13:19:04.543143 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.543103    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"]
Sep 11 13:19:04.547477 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:04.547450    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-37c1cf-9b4d77778-4qj9x"]
Sep 11 13:19:06.140951 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:06.140920    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f520d25e-920d-492d-84e3-2b0bad55aac1" path="/var/lib/kubelet/pods/f520d25e-920d-492d-84e3-2b0bad55aac1/volumes"
Sep 11 13:19:53.483649 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:53.483612    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"]
Sep 11 13:19:53.484111 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:53.483872    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy" containerID="cri-o://eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5" gracePeriod=30
Sep 11 13:19:58.743498 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.743473    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:19:58.800994 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.800908    2572 generic.go:356] "Generic (PLEG): container finished" podID="8708f428-a473-4205-87af-b2345a0f9ef0" containerID="eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5" exitCode=0
Sep 11 13:19:58.800994 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.800950    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"
Sep 11 13:19:58.800994 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.800980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" event={"ID":"8708f428-a473-4205-87af-b2345a0f9ef0","Type":"ContainerDied","Data":"eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5"}
Sep 11 13:19:58.801272 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.801038    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h" event={"ID":"8708f428-a473-4205-87af-b2345a0f9ef0","Type":"ContainerDied","Data":"7d266ba1a31d4e38defddf69fc489260b8769f101d1ef7a5670dda4033909ac0"}
Sep 11 13:19:58.801272 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.801062    2572 scope.go:117] "RemoveContainer" containerID="eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5"
Sep 11 13:19:58.818673 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.818647    2572 scope.go:117] "RemoveContainer" containerID="9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8"
Sep 11 13:19:58.826800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.826779    2572 scope.go:117] "RemoveContainer" containerID="eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5"
Sep 11 13:19:58.827070 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:19:58.827049    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5\": container with ID starting with eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5 not found: ID does not exist" containerID="eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5"
Sep 11 13:19:58.827119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.827081    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5"} err="failed to get container status \"eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5\": rpc error: code = NotFound desc = could not find container \"eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5\": container with ID starting with eefd4373be758d2a40c89bbf1cb17d34d2f225256807c47823738a660e8c71c5 not found: ID does not exist"
Sep 11 13:19:58.827119 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.827100    2572 scope.go:117] "RemoveContainer" containerID="9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8"
Sep 11 13:19:58.827387 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:19:58.827368    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8\": container with ID starting with 9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8 not found: ID does not exist" containerID="9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8"
Sep 11 13:19:58.827455 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.827392    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8"} err="failed to get container status \"9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8\": rpc error: code = NotFound desc = could not find container \"9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8\": container with ID starting with 9d5b7b4b39e93ccdefaf91680609badf176bb371eec833e02ce7e6fab3933bd8 not found: ID does not exist"
Sep 11 13:19:58.891788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.891748    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8708f428-a473-4205-87af-b2345a0f9ef0-istio-podinfo\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.891788 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.891790    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-credential-socket\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.891814    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-envoy\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.891872    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-socket\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.891918    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b6sb\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-kube-api-access-4b6sb\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.891958    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-istio-token\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.891994    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-certs\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892027    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8708f428-a473-4205-87af-b2345a0f9ef0-istiod-ca-cert\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892057    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-data\") pod \"8708f428-a473-4205-87af-b2345a0f9ef0\" (UID: \"8708f428-a473-4205-87af-b2345a0f9ef0\") "
Sep 11 13:19:58.892464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892177    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:58.892464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892221    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:58.892464 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892411    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-data" (OuterVolumeSpecName: "istio-data") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:58.892844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892475    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.892844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892496    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.892844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892510    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.892844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892599    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:58.892844 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.892770    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8708f428-a473-4205-87af-b2345a0f9ef0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:19:58.894418 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.894365    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8708f428-a473-4205-87af-b2345a0f9ef0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:19:58.894550 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.894369    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:19:58.894647 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.894626    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-kube-api-access-4b6sb" (OuterVolumeSpecName: "kube-api-access-4b6sb") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "kube-api-access-4b6sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:19:58.894727 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.894710    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-istio-token" (OuterVolumeSpecName: "istio-token") pod "8708f428-a473-4205-87af-b2345a0f9ef0" (UID: "8708f428-a473-4205-87af-b2345a0f9ef0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:19:58.993470 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.993420    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8708f428-a473-4205-87af-b2345a0f9ef0-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.993470 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.993463    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.993470 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.993473    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6sb\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-kube-api-access-4b6sb\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.993470 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.993484    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8708f428-a473-4205-87af-b2345a0f9ef0-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.993470 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.993493    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8708f428-a473-4205-87af-b2345a0f9ef0-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:58.993789 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:58.993500    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8708f428-a473-4205-87af-b2345a0f9ef0-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:19:59.124153 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:59.124120    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"]
Sep 11 13:19:59.130575 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:19:59.130542    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-37c1cf-openshift-default-d7797c69b-skx2h"]
Sep 11 13:20:00.139855 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:00.139824    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" path="/var/lib/kubelet/pods/8708f428-a473-4205-87af-b2345a0f9ef0/volumes"
Sep 11 13:20:04.494337 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.494286    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"]
Sep 11 13:20:04.494776 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.494606    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf" podUID="0212fcac-3731-4ae1-b078-4a9c89f5a8cc" containerName="payload-processing" containerID="cri-o://d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3" gracePeriod=30
Sep 11 13:20:04.506283 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.506252    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"]
Sep 11 13:20:04.506523 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.506494    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt" podUID="2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" containerName="payload-pre-processing" containerID="cri-o://5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564" gracePeriod=30
Sep 11 13:20:04.763500 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.763476    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:20:04.789536 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.789504    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:20:04.836463 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.836428    2572 generic.go:356] "Generic (PLEG): container finished" podID="2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" containerID="5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564" exitCode=0
Sep 11 13:20:04.836672 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.836473    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"
Sep 11 13:20:04.836672 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.836505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt" event={"ID":"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0","Type":"ContainerDied","Data":"5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564"}
Sep 11 13:20:04.836672 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.836570    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt" event={"ID":"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0","Type":"ContainerDied","Data":"b6791b651caa4fc324ccde558dd151abbbcf597e3a23d3cb53f31c2938fbec85"}
Sep 11 13:20:04.836672 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.836601    2572 scope.go:117] "RemoveContainer" containerID="5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564"
Sep 11 13:20:04.838052 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.838032    2572 generic.go:356] "Generic (PLEG): container finished" podID="0212fcac-3731-4ae1-b078-4a9c89f5a8cc" containerID="d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3" exitCode=0
Sep 11 13:20:04.838156 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.838087    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"
Sep 11 13:20:04.838156 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.838105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf" event={"ID":"0212fcac-3731-4ae1-b078-4a9c89f5a8cc","Type":"ContainerDied","Data":"d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3"}
Sep 11 13:20:04.838156 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.838147    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf" event={"ID":"0212fcac-3731-4ae1-b078-4a9c89f5a8cc","Type":"ContainerDied","Data":"d9ec7a7278f76bf1ee5ed49b07094bbd71b6283df5e0ce37d5c0d619cf777669"}
Sep 11 13:20:04.845547 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.845527    2572 scope.go:117] "RemoveContainer" containerID="5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564"
Sep 11 13:20:04.845835 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:20:04.845818    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564\": container with ID starting with 5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564 not found: ID does not exist" containerID="5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564"
Sep 11 13:20:04.845910 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.845846    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564"} err="failed to get container status \"5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564\": rpc error: code = NotFound desc = could not find container \"5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564\": container with ID starting with 5b1744c43cc0921874acc30a4e656680a953ccfe7a9ccc1a0f6ac87f3c541564 not found: ID does not exist"
Sep 11 13:20:04.845910 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.845868    2572 scope.go:117] "RemoveContainer" containerID="d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3"
Sep 11 13:20:04.854078 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.854059    2572 scope.go:117] "RemoveContainer" containerID="d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3"
Sep 11 13:20:04.854421 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:20:04.854398    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3\": container with ID starting with d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3 not found: ID does not exist" containerID="d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3"
Sep 11 13:20:04.854491 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.854427    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3"} err="failed to get container status \"d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3\": rpc error: code = NotFound desc = could not find container \"d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3\": container with ID starting with d52943a62569338baff87ced6a7fda8d6753323eb98dc945ebf36417126b19a3 not found: ID does not exist"
Sep 11 13:20:04.952538 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.952505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdbd6\" (UniqueName: \"kubernetes.io/projected/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-kube-api-access-pdbd6\") pod \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") "
Sep 11 13:20:04.952744 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.952556    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnn4k\" (UniqueName: \"kubernetes.io/projected/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-kube-api-access-lnn4k\") pod \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") "
Sep 11 13:20:04.952744 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.952687    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-plugins-config-volume\") pod \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\" (UID: \"0212fcac-3731-4ae1-b078-4a9c89f5a8cc\") "
Sep 11 13:20:04.952744 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.952727    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-plugins-config-volume\") pod \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\" (UID: \"2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0\") "
Sep 11 13:20:04.953063 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.953038    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0212fcac-3731-4ae1-b078-4a9c89f5a8cc" (UID: "0212fcac-3731-4ae1-b078-4a9c89f5a8cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:04.953190 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.953126    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" (UID: "2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:04.954888 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.954867    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-kube-api-access-lnn4k" (OuterVolumeSpecName: "kube-api-access-lnn4k") pod "2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" (UID: "2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0"). InnerVolumeSpecName "kube-api-access-lnn4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:04.954967 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:04.954890    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-kube-api-access-pdbd6" (OuterVolumeSpecName: "kube-api-access-pdbd6") pod "0212fcac-3731-4ae1-b078-4a9c89f5a8cc" (UID: "0212fcac-3731-4ae1-b078-4a9c89f5a8cc"). InnerVolumeSpecName "kube-api-access-pdbd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:05.054499 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.054413    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdbd6\" (UniqueName: \"kubernetes.io/projected/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-kube-api-access-pdbd6\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:05.054499 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.054441    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnn4k\" (UniqueName: \"kubernetes.io/projected/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-kube-api-access-lnn4k\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:05.054499 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.054451    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0212fcac-3731-4ae1-b078-4a9c89f5a8cc-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:05.054499 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.054459    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:05.175795 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.175750    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"]
Sep 11 13:20:05.177637 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.177613    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06286a-7c9bff9646-w69vt"]
Sep 11 13:20:05.198554 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.198525    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"]
Sep 11 13:20:05.202932 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:05.202905    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06286a-d8b945b65-4f8sf"]
Sep 11 13:20:06.140298 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:06.140262    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0212fcac-3731-4ae1-b078-4a9c89f5a8cc" path="/var/lib/kubelet/pods/0212fcac-3731-4ae1-b078-4a9c89f5a8cc/volumes"
Sep 11 13:20:06.140706 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:06.140660    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" path="/var/lib/kubelet/pods/2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0/volumes"
Sep 11 13:20:11.925753 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.925675    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"]
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926081    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f520d25e-920d-492d-84e3-2b0bad55aac1" containerName="payload-pre-processing"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926095    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f520d25e-920d-492d-84e3-2b0bad55aac1" containerName="payload-pre-processing"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926104    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926109    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926122    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926127    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926136    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926141    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926150    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" containerName="payload-pre-processing"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926155    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" containerName="payload-pre-processing"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926163    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="062e48ae-cfd2-4961-8f93-f1b37a62c6f2" containerName="revoke-keys"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926167    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="062e48ae-cfd2-4961-8f93-f1b37a62c6f2" containerName="revoke-keys"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926176    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926181    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926186    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0212fcac-3731-4ae1-b078-4a9c89f5a8cc" containerName="payload-processing"
Sep 11 13:20:11.926217 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926191    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0212fcac-3731-4ae1-b078-4a9c89f5a8cc" containerName="payload-processing"
Sep 11 13:20:11.926734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926247    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy"
Sep 11 13:20:11.926734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926256    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy"
Sep 11 13:20:11.926734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926263    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f520d25e-920d-492d-84e3-2b0bad55aac1" containerName="payload-pre-processing"
Sep 11 13:20:11.926734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926269    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8708f428-a473-4205-87af-b2345a0f9ef0" containerName="istio-proxy"
Sep 11 13:20:11.926734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926274    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0212fcac-3731-4ae1-b078-4a9c89f5a8cc" containerName="payload-processing"
Sep 11 13:20:11.926734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926279    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7e525f-d1ea-4fe0-a4ac-9eea030c26d0" containerName="payload-pre-processing"
Sep 11 13:20:11.926734 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.926283    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="062e48ae-cfd2-4961-8f93-f1b37a62c6f2" containerName="revoke-keys"
Sep 11 13:20:11.929427 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.929409    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"
Sep 11 13:20:11.931566 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.931545    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:20:11.931695 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.931548    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:20:11.937742 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:11.937719    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"]
Sep 11 13:20:12.014368 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.014310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18c9b96-93b8-4181-a794-fc09970c86b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4\" (UID: \"f18c9b96-93b8-4181-a794-fc09970c86b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"
Sep 11 13:20:12.115142 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.115107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18c9b96-93b8-4181-a794-fc09970c86b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4\" (UID: \"f18c9b96-93b8-4181-a794-fc09970c86b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"
Sep 11 13:20:12.115767 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.115750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18c9b96-93b8-4181-a794-fc09970c86b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4\" (UID: \"f18c9b96-93b8-4181-a794-fc09970c86b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"
Sep 11 13:20:12.239498 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.239414    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"
Sep 11 13:20:12.510992 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.510965    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"]
Sep 11 13:20:12.513629 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:20:12.513598    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18c9b96_93b8_4181_a794_fc09970c86b1.slice/crio-3b7064d446d5cb569ef5ff224c371d58be9f8bc18db5ed4f9a116c37b1a1dc56 WatchSource:0}: Error finding container 3b7064d446d5cb569ef5ff224c371d58be9f8bc18db5ed4f9a116c37b1a1dc56: Status 404 returned error can't find the container with id 3b7064d446d5cb569ef5ff224c371d58be9f8bc18db5ed4f9a116c37b1a1dc56
Sep 11 13:20:12.881935 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.881842    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4" event={"ID":"f18c9b96-93b8-4181-a794-fc09970c86b1","Type":"ContainerStarted","Data":"451ff2a512e238227baed61b06a7b838ee82d299f51b6c24bc4ea7ac66a092ce"}
Sep 11 13:20:12.881935 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.881893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4" event={"ID":"f18c9b96-93b8-4181-a794-fc09970c86b1","Type":"ContainerStarted","Data":"3b7064d446d5cb569ef5ff224c371d58be9f8bc18db5ed4f9a116c37b1a1dc56"}
Sep 11 13:20:12.898435 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:12.898362    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4" podStartSLOduration=1.8983450290000001 podStartE2EDuration="1.898345029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:12.897538241 +0000 UTC m=+1977.277064176" watchObservedRunningTime="2026-09-11 13:20:12.898345029 +0000 UTC m=+1977.277870966"
Sep 11 13:20:13.889168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:13.889135    2572 generic.go:356] "Generic (PLEG): container finished" podID="f18c9b96-93b8-4181-a794-fc09970c86b1" containerID="451ff2a512e238227baed61b06a7b838ee82d299f51b6c24bc4ea7ac66a092ce" exitCode=0
Sep 11 13:20:13.889593 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:13.889202    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4" event={"ID":"f18c9b96-93b8-4181-a794-fc09970c86b1","Type":"ContainerDied","Data":"451ff2a512e238227baed61b06a7b838ee82d299f51b6c24bc4ea7ac66a092ce"}
Sep 11 13:20:15.019707 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:15.019682    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"
Sep 11 13:20:15.043174 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:15.042546    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18c9b96-93b8-4181-a794-fc09970c86b1-maas-api-service-ca\") pod \"f18c9b96-93b8-4181-a794-fc09970c86b1\" (UID: \"f18c9b96-93b8-4181-a794-fc09970c86b1\") "
Sep 11 13:20:15.044347 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:15.043498    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f18c9b96-93b8-4181-a794-fc09970c86b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f18c9b96-93b8-4181-a794-fc09970c86b1" (UID: "f18c9b96-93b8-4181-a794-fc09970c86b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:15.143963 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:15.143931    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f18c9b96-93b8-4181-a794-fc09970c86b1-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:15.900639 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:15.900597    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4" event={"ID":"f18c9b96-93b8-4181-a794-fc09970c86b1","Type":"ContainerDied","Data":"3b7064d446d5cb569ef5ff224c371d58be9f8bc18db5ed4f9a116c37b1a1dc56"}
Sep 11 13:20:15.900639 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:15.900626    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"
Sep 11 13:20:15.900869 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:15.900658    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b7064d446d5cb569ef5ff224c371d58be9f8bc18db5ed4f9a116c37b1a1dc56"
Sep 11 13:20:16.491617 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:16.491588    2572 scope.go:117] "RemoveContainer" containerID="c3a917b68e13a00951dc7eb1af01c0654ea3e8a5298d5386e5fff47c7720d234"
Sep 11 13:20:16.499654 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:16.499636    2572 scope.go:117] "RemoveContainer" containerID="fcf24df750f4c9f09cddb2fbdce536b85c938a37e4f82ec5dfbe6e292403878c"
Sep 11 13:20:22.711149 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:22.711114    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"]
Sep 11 13:20:22.713800 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:22.713776    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d4b0b9-hzcf4"]
Sep 11 13:20:24.139944 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:24.139910    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f18c9b96-93b8-4181-a794-fc09970c86b1" path="/var/lib/kubelet/pods/f18c9b96-93b8-4181-a794-fc09970c86b1/volumes"
Sep 11 13:20:30.204185 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.204151    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"]
Sep 11 13:20:30.204625 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.204538    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f18c9b96-93b8-4181-a794-fc09970c86b1" containerName="revoke-keys"
Sep 11 13:20:30.204625 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.204550    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f18c9b96-93b8-4181-a794-fc09970c86b1" containerName="revoke-keys"
Sep 11 13:20:30.204625 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.204606    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f18c9b96-93b8-4181-a794-fc09970c86b1" containerName="revoke-keys"
Sep 11 13:20:30.204625 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.204614    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6ec096-29b1-4c32-b272-6a99bb34d071" containerName="istio-proxy"
Sep 11 13:20:30.206479 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.206462    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"
Sep 11 13:20:30.208497 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.208477    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:20:30.208497 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.208484    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs8sd\""
Sep 11 13:20:30.214872 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.214847    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"]
Sep 11 13:20:30.290274 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.290245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/194f6f61-35a0-45c6-9de5-f708667747c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk\" (UID: \"194f6f61-35a0-45c6-9de5-f708667747c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"
Sep 11 13:20:30.391144 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.391116    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/194f6f61-35a0-45c6-9de5-f708667747c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk\" (UID: \"194f6f61-35a0-45c6-9de5-f708667747c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"
Sep 11 13:20:30.391748 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.391729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/194f6f61-35a0-45c6-9de5-f708667747c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk\" (UID: \"194f6f61-35a0-45c6-9de5-f708667747c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"
Sep 11 13:20:30.518043 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.517961    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"
Sep 11 13:20:30.788598 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.788575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"]
Sep 11 13:20:30.790661 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:20:30.790635    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194f6f61_35a0_45c6_9de5_f708667747c5.slice/crio-30ea28f3eea768604ed85b544a21af8874f27126538f0b71cdfbffd2213b4093 WatchSource:0}: Error finding container 30ea28f3eea768604ed85b544a21af8874f27126538f0b71cdfbffd2213b4093: Status 404 returned error can't find the container with id 30ea28f3eea768604ed85b544a21af8874f27126538f0b71cdfbffd2213b4093
Sep 11 13:20:30.973540 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:30.973500    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk" event={"ID":"194f6f61-35a0-45c6-9de5-f708667747c5","Type":"ContainerStarted","Data":"30ea28f3eea768604ed85b544a21af8874f27126538f0b71cdfbffd2213b4093"}
Sep 11 13:20:31.979830 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:31.979797    2572 generic.go:356] "Generic (PLEG): container finished" podID="194f6f61-35a0-45c6-9de5-f708667747c5" containerID="182b01e7749ae8e95be65e6fbe194c305d7a9cd475d09db805c5753bb00a22d6" exitCode=0
Sep 11 13:20:31.980227 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:31.979893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk" event={"ID":"194f6f61-35a0-45c6-9de5-f708667747c5","Type":"ContainerDied","Data":"182b01e7749ae8e95be65e6fbe194c305d7a9cd475d09db805c5753bb00a22d6"}
Sep 11 13:20:33.116907 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:33.116883    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"
Sep 11 13:20:33.217588 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:33.217558    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/194f6f61-35a0-45c6-9de5-f708667747c5-maas-api-service-ca\") pod \"194f6f61-35a0-45c6-9de5-f708667747c5\" (UID: \"194f6f61-35a0-45c6-9de5-f708667747c5\") "
Sep 11 13:20:33.217954 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:33.217934    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194f6f61-35a0-45c6-9de5-f708667747c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "194f6f61-35a0-45c6-9de5-f708667747c5" (UID: "194f6f61-35a0-45c6-9de5-f708667747c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:33.319050 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:33.318948    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/194f6f61-35a0-45c6-9de5-f708667747c5-maas-api-service-ca\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:33.991182 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:33.991151    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"
Sep 11 13:20:33.991382 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:33.991152    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk" event={"ID":"194f6f61-35a0-45c6-9de5-f708667747c5","Type":"ContainerDied","Data":"30ea28f3eea768604ed85b544a21af8874f27126538f0b71cdfbffd2213b4093"}
Sep 11 13:20:33.991382 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:33.991280    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30ea28f3eea768604ed85b544a21af8874f27126538f0b71cdfbffd2213b4093"
Sep 11 13:20:40.893133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:40.893099    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"]
Sep 11 13:20:40.898984 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:40.898957    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-2e7f38-29818875-gph8h"]
Sep 11 13:20:40.939290 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:40.939257    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"]
Sep 11 13:20:40.939626 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:40.939575    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822" podUID="7aba9c03-ce22-4758-999b-5fa864f4f82e" containerName="payload-processing" containerID="cri-o://70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79" gracePeriod=30
Sep 11 13:20:40.956679 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:40.956655    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"]
Sep 11 13:20:40.956894 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:40.956853    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v" podUID="a28589a6-aa59-4b09-9148-d80735228b01" containerName="payload-pre-processing" containerID="cri-o://e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a" gracePeriod=30
Sep 11 13:20:41.208309 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.208275    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"]
Sep 11 13:20:41.213361 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.213314    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-2e7f38-4mjnk"]
Sep 11 13:20:41.216606 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.216586    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:20:41.219184 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.219165    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:20:41.391381 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.391346    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a28589a6-aa59-4b09-9148-d80735228b01-plugins-config-volume\") pod \"a28589a6-aa59-4b09-9148-d80735228b01\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") "
Sep 11 13:20:41.391559 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.391432    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aba9c03-ce22-4758-999b-5fa864f4f82e-plugins-config-volume\") pod \"7aba9c03-ce22-4758-999b-5fa864f4f82e\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") "
Sep 11 13:20:41.391559 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.391462    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gns4r\" (UniqueName: \"kubernetes.io/projected/7aba9c03-ce22-4758-999b-5fa864f4f82e-kube-api-access-gns4r\") pod \"7aba9c03-ce22-4758-999b-5fa864f4f82e\" (UID: \"7aba9c03-ce22-4758-999b-5fa864f4f82e\") "
Sep 11 13:20:41.391559 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.391481    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdt2g\" (UniqueName: \"kubernetes.io/projected/a28589a6-aa59-4b09-9148-d80735228b01-kube-api-access-tdt2g\") pod \"a28589a6-aa59-4b09-9148-d80735228b01\" (UID: \"a28589a6-aa59-4b09-9148-d80735228b01\") "
Sep 11 13:20:41.391749 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.391722    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a28589a6-aa59-4b09-9148-d80735228b01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a28589a6-aa59-4b09-9148-d80735228b01" (UID: "a28589a6-aa59-4b09-9148-d80735228b01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:41.391867 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.391843    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aba9c03-ce22-4758-999b-5fa864f4f82e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7aba9c03-ce22-4758-999b-5fa864f4f82e" (UID: "7aba9c03-ce22-4758-999b-5fa864f4f82e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:41.393773 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.393753    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aba9c03-ce22-4758-999b-5fa864f4f82e-kube-api-access-gns4r" (OuterVolumeSpecName: "kube-api-access-gns4r") pod "7aba9c03-ce22-4758-999b-5fa864f4f82e" (UID: "7aba9c03-ce22-4758-999b-5fa864f4f82e"). InnerVolumeSpecName "kube-api-access-gns4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:41.393877 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.393776    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a28589a6-aa59-4b09-9148-d80735228b01-kube-api-access-tdt2g" (OuterVolumeSpecName: "kube-api-access-tdt2g") pod "a28589a6-aa59-4b09-9148-d80735228b01" (UID: "a28589a6-aa59-4b09-9148-d80735228b01"). InnerVolumeSpecName "kube-api-access-tdt2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:41.492736 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.492649    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a28589a6-aa59-4b09-9148-d80735228b01-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:41.492736 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.492677    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aba9c03-ce22-4758-999b-5fa864f4f82e-plugins-config-volume\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:41.492736 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.492687    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gns4r\" (UniqueName: \"kubernetes.io/projected/7aba9c03-ce22-4758-999b-5fa864f4f82e-kube-api-access-gns4r\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:41.492736 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:41.492696    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdt2g\" (UniqueName: \"kubernetes.io/projected/a28589a6-aa59-4b09-9148-d80735228b01-kube-api-access-tdt2g\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:42.030457 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.030426    2572 generic.go:356] "Generic (PLEG): container finished" podID="a28589a6-aa59-4b09-9148-d80735228b01" containerID="e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a" exitCode=0
Sep 11 13:20:42.030887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.030469    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"
Sep 11 13:20:42.030887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.030518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v" event={"ID":"a28589a6-aa59-4b09-9148-d80735228b01","Type":"ContainerDied","Data":"e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a"}
Sep 11 13:20:42.030887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.030572    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v" event={"ID":"a28589a6-aa59-4b09-9148-d80735228b01","Type":"ContainerDied","Data":"72ee5cfb2f6a79a15f51f8b2f98061a7d46eef25c4d0a321b7634431b7258301"}
Sep 11 13:20:42.030887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.030597    2572 scope.go:117] "RemoveContainer" containerID="e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a"
Sep 11 13:20:42.031965 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.031942    2572 generic.go:356] "Generic (PLEG): container finished" podID="7aba9c03-ce22-4758-999b-5fa864f4f82e" containerID="70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79" exitCode=0
Sep 11 13:20:42.032062 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.031988    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"
Sep 11 13:20:42.032062 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.032032    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822" event={"ID":"7aba9c03-ce22-4758-999b-5fa864f4f82e","Type":"ContainerDied","Data":"70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79"}
Sep 11 13:20:42.032166 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.032083    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822" event={"ID":"7aba9c03-ce22-4758-999b-5fa864f4f82e","Type":"ContainerDied","Data":"16d5fd84f0d7a0a6dde07c5d7e94294e8c4c94909a9ef7f718cba327d52195fe"}
Sep 11 13:20:42.039924 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.039908    2572 scope.go:117] "RemoveContainer" containerID="e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a"
Sep 11 13:20:42.040219 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:20:42.040201    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a\": container with ID starting with e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a not found: ID does not exist" containerID="e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a"
Sep 11 13:20:42.040282 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.040229    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a"} err="failed to get container status \"e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a\": rpc error: code = NotFound desc = could not find container \"e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a\": container with ID starting with e1c7da2cd2f4d536ce0fdfccffd572cf3b4b8615f042674e506291d1bb1a353a not found: ID does not exist"
Sep 11 13:20:42.040282 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.040246    2572 scope.go:117] "RemoveContainer" containerID="70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79"
Sep 11 13:20:42.048152 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.048137    2572 scope.go:117] "RemoveContainer" containerID="70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79"
Sep 11 13:20:42.048483 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:20:42.048467    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79\": container with ID starting with 70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79 not found: ID does not exist" containerID="70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79"
Sep 11 13:20:42.048528 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.048490    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79"} err="failed to get container status \"70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79\": rpc error: code = NotFound desc = could not find container \"70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79\": container with ID starting with 70fd04404ecc51aa021c82fc0860de7bf5f4931a0297078470645bc6f941bd79 not found: ID does not exist"
Sep 11 13:20:42.054139 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.054117    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"]
Sep 11 13:20:42.058735 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.058716    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2e7f38-7bc9b6b958-fv98v"]
Sep 11 13:20:42.076046 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.076028    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"]
Sep 11 13:20:42.079634 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.079608    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-2e7f38-cfd869995-gv822"]
Sep 11 13:20:42.138970 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.138939    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194f6f61-35a0-45c6-9de5-f708667747c5" path="/var/lib/kubelet/pods/194f6f61-35a0-45c6-9de5-f708667747c5/volumes"
Sep 11 13:20:42.139290 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.139274    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc07307-c642-4183-971d-38c3805e4bbb" path="/var/lib/kubelet/pods/6dc07307-c642-4183-971d-38c3805e4bbb/volumes"
Sep 11 13:20:42.139602 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.139589    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aba9c03-ce22-4758-999b-5fa864f4f82e" path="/var/lib/kubelet/pods/7aba9c03-ce22-4758-999b-5fa864f4f82e/volumes"
Sep 11 13:20:42.139916 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:42.139904    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a28589a6-aa59-4b09-9148-d80735228b01" path="/var/lib/kubelet/pods/a28589a6-aa59-4b09-9148-d80735228b01/volumes"
Sep 11 13:20:48.946887 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:48.946843    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"]
Sep 11 13:20:48.947494 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:48.947104    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy" containerID="cri-o://cd20c29b4bc751d829b290695b1512faeccae76f55d3421a857879be6f7ea702" gracePeriod=30
Sep 11 13:20:54.092678 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.092643    2572 generic.go:356] "Generic (PLEG): container finished" podID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerID="cd20c29b4bc751d829b290695b1512faeccae76f55d3421a857879be6f7ea702" exitCode=0
Sep 11 13:20:54.093059 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.092715    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" event={"ID":"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e","Type":"ContainerDied","Data":"cd20c29b4bc751d829b290695b1512faeccae76f55d3421a857879be6f7ea702"}
Sep 11 13:20:54.093059 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.092775    2572 scope.go:117] "RemoveContainer" containerID="072c799403ed9f67b23eb87e717950d8f9809de6a32f5fcd44525743d1b6fa36"
Sep 11 13:20:54.201634 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.201606    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:20:54.302522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302435    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-podinfo\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302483    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-data\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istiod-ca-cert\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302544    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-socket\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302571    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-token\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302595    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-envoy\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302639    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-credential-socket\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302729    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ltd9\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-kube-api-access-8ltd9\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.302787 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302773    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-certs\") pod \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\" (UID: \"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e\") "
Sep 11 13:20:54.303110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302822    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:54.303110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.302873    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:54.303110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.303004    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:20:54.303110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.303063    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:54.303110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.303083    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:54.303439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.303117    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-data\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.303439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.303140    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istiod-ca-cert\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.303439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.303154    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.304897 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.304865    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:20:54.305029 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.304956    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:54.305099 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.305065    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-kube-api-access-8ltd9" (OuterVolumeSpecName: "kube-api-access-8ltd9") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "kube-api-access-8ltd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:54.305099 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.305081    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" (UID: "6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:54.403750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.403700    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltd9\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-kube-api-access-8ltd9\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.403750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.403745    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-workload-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.403750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.403755    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-podinfo\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.403750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.403762    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-token\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.404023 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.403770    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-istio-envoy\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:54.404023 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:54.403778    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e-credential-socket\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:20:55.103183 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:55.103143    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"
Sep 11 13:20:55.103712 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:55.103136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792" event={"ID":"6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e","Type":"ContainerDied","Data":"02473da1508169b12e64e8e96e31bef7abaeabe21f1a46ab4843b807e712f0e2"}
Sep 11 13:20:55.103712 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:55.103305    2572 scope.go:117] "RemoveContainer" containerID="cd20c29b4bc751d829b290695b1512faeccae76f55d3421a857879be6f7ea702"
Sep 11 13:20:55.127623 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:55.127230    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"]
Sep 11 13:20:55.128691 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:55.128668    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-2e7f38-openshift-default-849b55bc6d-nx792"]
Sep 11 13:20:56.140449 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:20:56.140416    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" path="/var/lib/kubelet/pods/6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e/volumes"
Sep 11 13:21:16.530660 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:21:16.530630    2572 scope.go:117] "RemoveContainer" containerID="9e02494bd52e4690b2eaad16685849116262d2e7959e9c30afa14d9d9addd804"
Sep 11 13:21:16.538808 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:21:16.538785    2572 scope.go:117] "RemoveContainer" containerID="163aadf9bf38e958d6a4fcac749a043f87e4f4b8be49283faf061e373c412467"
Sep 11 13:21:16.546172 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:21:16.546154    2572 scope.go:117] "RemoveContainer" containerID="3260ed7fedc9d19902f0e5642a7c41d18eb7487d4e32d48ed3c88f8306493ef9"
Sep 11 13:21:16.552967 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:21:16.552951    2572 scope.go:117] "RemoveContainer" containerID="f8317e3b846fdc4d3010fde5d0c2aed3718b4e0d31c7fe203c662d31110a411a"
Sep 11 13:22:16.211888 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:22:16.211857    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:22:16.217630 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:22:16.217611    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:25:10.660453 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660409    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"]
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660902    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a28589a6-aa59-4b09-9148-d80735228b01" containerName="payload-pre-processing"
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660921    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a28589a6-aa59-4b09-9148-d80735228b01" containerName="payload-pre-processing"
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660940    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy"
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660948    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy"
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660962    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aba9c03-ce22-4758-999b-5fa864f4f82e" containerName="payload-processing"
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660971    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aba9c03-ce22-4758-999b-5fa864f4f82e" containerName="payload-processing"
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.660999    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194f6f61-35a0-45c6-9de5-f708667747c5" containerName="revoke-keys"
Sep 11 13:25:10.661022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.661007    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="194f6f61-35a0-45c6-9de5-f708667747c5" containerName="revoke-keys"
Sep 11 13:25:10.661461 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.661084    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aba9c03-ce22-4758-999b-5fa864f4f82e" containerName="payload-processing"
Sep 11 13:25:10.661461 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.661098    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy"
Sep 11 13:25:10.661461 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.661108    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy"
Sep 11 13:25:10.661461 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.661118    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="194f6f61-35a0-45c6-9de5-f708667747c5" containerName="revoke-keys"
Sep 11 13:25:10.661461 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.661126    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a28589a6-aa59-4b09-9148-d80735228b01" containerName="payload-pre-processing"
Sep 11 13:25:10.664139 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.664120    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.671499 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.671478    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c2ce48f8-kserve-self-signed-certs\""
Sep 11 13:25:10.704491 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.704460    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"]
Sep 11 13:25:10.763168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.763139    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-dshm\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.763168 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.763172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-model-cache\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.763439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.763223    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tmp-dir\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.763439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.763238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-home\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.763439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.763349    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tls-certs\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.763439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.763368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q22kh\" (UniqueName: \"kubernetes.io/projected/c45f9c46-765f-4a63-9c7e-e6132d8da09b-kube-api-access-q22kh\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.864792 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.864753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-dshm\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.864792 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.864791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-model-cache\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.865047 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.864830    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tmp-dir\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.865047 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.864852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-home\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.865047 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.864919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tls-certs\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.865198 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.865055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22kh\" (UniqueName: \"kubernetes.io/projected/c45f9c46-765f-4a63-9c7e-e6132d8da09b-kube-api-access-q22kh\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.865251 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.865195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-model-cache\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.865306 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.865262    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tmp-dir\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.865403 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.865340    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-home\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.867314 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.867286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-dshm\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.867439 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.867393    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tls-certs\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.878888 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.878864    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q22kh\" (UniqueName: \"kubernetes.io/projected/c45f9c46-765f-4a63-9c7e-e6132d8da09b-kube-api-access-q22kh\") pod \"e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") " pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:10.974580 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:10.974484    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:11.269942 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:11.269861    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"]
Sep 11 13:25:11.272932 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:25:11.272911    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc45f9c46_765f_4a63_9c7e_e6132d8da09b.slice/crio-6236bb0af530d44d093854d1fa4b4f639282f3d7e62e68de72901beec20fb06a WatchSource:0}: Error finding container 6236bb0af530d44d093854d1fa4b4f639282f3d7e62e68de72901beec20fb06a: Status 404 returned error can't find the container with id 6236bb0af530d44d093854d1fa4b4f639282f3d7e62e68de72901beec20fb06a
Sep 11 13:25:11.279670 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:11.279641    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk" event={"ID":"c45f9c46-765f-4a63-9c7e-e6132d8da09b","Type":"ContainerStarted","Data":"6236bb0af530d44d093854d1fa4b4f639282f3d7e62e68de72901beec20fb06a"}
Sep 11 13:25:12.285494 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:12.285458    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk" event={"ID":"c45f9c46-765f-4a63-9c7e-e6132d8da09b","Type":"ContainerStarted","Data":"191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987"}
Sep 11 13:25:12.307216 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:12.307153    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk" podStartSLOduration=2.30713818 podStartE2EDuration="2.30713818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:25:12.30555745 +0000 UTC m=+2276.685083386" watchObservedRunningTime="2026-09-11 13:25:12.30713818 +0000 UTC m=+2276.686664116"
Sep 11 13:25:16.611169 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:16.611138    2572 scope.go:117] "RemoveContainer" containerID="55fd53f6c20012e9a314efb555a94ede8085034233197d467b676bbdf96e069c"
Sep 11 13:25:20.974853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:20.974812    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:20.974853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:20.974864    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:20.988281 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:20.988254    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:21.340106 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:21.340006    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:25:58.942353 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:25:58.942306    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"]
Sep 11 13:26:13.961154 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:13.961046    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk" podUID="c45f9c46-765f-4a63-9c7e-e6132d8da09b" containerName="main" containerID="cri-o://191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987" gracePeriod=45
Sep 11 13:26:14.202077 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.202046    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:26:14.343466 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343380    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-dshm\") pod \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") "
Sep 11 13:26:14.343466 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343429    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-home\") pod \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") "
Sep 11 13:26:14.343466 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343465    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tls-certs\") pod \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") "
Sep 11 13:26:14.343769 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343511    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tmp-dir\") pod \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") "
Sep 11 13:26:14.343769 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343553    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-model-cache\") pod \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") "
Sep 11 13:26:14.343769 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343593    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q22kh\" (UniqueName: \"kubernetes.io/projected/c45f9c46-765f-4a63-9c7e-e6132d8da09b-kube-api-access-q22kh\") pod \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\" (UID: \"c45f9c46-765f-4a63-9c7e-e6132d8da09b\") "
Sep 11 13:26:14.343923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343783    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c45f9c46-765f-4a63-9c7e-e6132d8da09b" (UID: "c45f9c46-765f-4a63-9c7e-e6132d8da09b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:14.343923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343807    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-home" (OuterVolumeSpecName: "home") pod "c45f9c46-765f-4a63-9c7e-e6132d8da09b" (UID: "c45f9c46-765f-4a63-9c7e-e6132d8da09b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:14.343923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343823    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-model-cache" (OuterVolumeSpecName: "model-cache") pod "c45f9c46-765f-4a63-9c7e-e6132d8da09b" (UID: "c45f9c46-765f-4a63-9c7e-e6132d8da09b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:14.343923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343911    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-home\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:26:14.344060 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343932    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tmp-dir\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:26:14.344060 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.343949    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-model-cache\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:26:14.345785 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.345759    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45f9c46-765f-4a63-9c7e-e6132d8da09b-kube-api-access-q22kh" (OuterVolumeSpecName: "kube-api-access-q22kh") pod "c45f9c46-765f-4a63-9c7e-e6132d8da09b" (UID: "c45f9c46-765f-4a63-9c7e-e6132d8da09b"). InnerVolumeSpecName "kube-api-access-q22kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:26:14.345785 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.345778    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c45f9c46-765f-4a63-9c7e-e6132d8da09b" (UID: "c45f9c46-765f-4a63-9c7e-e6132d8da09b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:26:14.345917 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.345832    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-dshm" (OuterVolumeSpecName: "dshm") pod "c45f9c46-765f-4a63-9c7e-e6132d8da09b" (UID: "c45f9c46-765f-4a63-9c7e-e6132d8da09b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:14.444638 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.444603    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45f9c46-765f-4a63-9c7e-e6132d8da09b-dshm\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:26:14.444638 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.444631    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45f9c46-765f-4a63-9c7e-e6132d8da09b-tls-certs\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:26:14.444638 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.444642    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q22kh\" (UniqueName: \"kubernetes.io/projected/c45f9c46-765f-4a63-9c7e-e6132d8da09b-kube-api-access-q22kh\") on node \"ip-10-0-136-247.ec2.internal\" DevicePath \"\""
Sep 11 13:26:14.583086 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.583051    2572 generic.go:356] "Generic (PLEG): container finished" podID="c45f9c46-765f-4a63-9c7e-e6132d8da09b" containerID="191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987" exitCode=0
Sep 11 13:26:14.583254 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.583109    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"
Sep 11 13:26:14.583254 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.583115    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk" event={"ID":"c45f9c46-765f-4a63-9c7e-e6132d8da09b","Type":"ContainerDied","Data":"191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987"}
Sep 11 13:26:14.583254 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.583215    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk" event={"ID":"c45f9c46-765f-4a63-9c7e-e6132d8da09b","Type":"ContainerDied","Data":"6236bb0af530d44d093854d1fa4b4f639282f3d7e62e68de72901beec20fb06a"}
Sep 11 13:26:14.583254 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.583231    2572 scope.go:117] "RemoveContainer" containerID="191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987"
Sep 11 13:26:14.594133 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.594112    2572 scope.go:117] "RemoveContainer" containerID="191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987"
Sep 11 13:26:14.594479 ip-10-0-136-247 kubenswrapper[2572]: E0911 13:26:14.594459    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987\": container with ID starting with 191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987 not found: ID does not exist" containerID="191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987"
Sep 11 13:26:14.594546 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.594489    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987"} err="failed to get container status \"191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987\": rpc error: code = NotFound desc = could not find container \"191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987\": container with ID starting with 191ea442b2c2df71ac462e122e751e0ae0bfa5e7ff9221721fe896efaf54a987 not found: ID does not exist"
Sep 11 13:26:14.604904 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.604876    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"]
Sep 11 13:26:14.608371 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:14.608346    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c2ce48f8-kserve-649fbb5d55-64cdk"]
Sep 11 13:26:16.139750 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:16.139718    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45f9c46-765f-4a63-9c7e-e6132d8da09b" path="/var/lib/kubelet/pods/c45f9c46-765f-4a63-9c7e-e6132d8da09b/volumes"
Sep 11 13:26:16.629332 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:16.629301    2572 scope.go:117] "RemoveContainer" containerID="451ff2a512e238227baed61b06a7b838ee82d299f51b6c24bc4ea7ac66a092ce"
Sep 11 13:26:57.772674 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:57.772646    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-grzwd_b69e3466-801b-439e-9141-2ba086a73d51/manager/0.log"
Sep 11 13:26:58.167694 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:58.167668    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wssvg_edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4/server/0.log"
Sep 11 13:26:58.655851 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:58.655825    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-zh98f_c58533ed-29e8-4fd8-8fcf-b8c841556f1d/copy-manifests/0.log"
Sep 11 13:26:58.667989 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:26:58.667956    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-zh98f_c58533ed-29e8-4fd8-8fcf-b8c841556f1d/manager/0.log"
Sep 11 13:27:00.379433 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:00.379396    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-9t8p8_51b842ec-53d9-405c-8f6c-f927317249ed/manager/0.log"
Sep 11 13:27:01.007561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:01.007520    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-5dbbk_5766aadd-5749-4d77-bd13-850382c36559/manager/0.log"
Sep 11 13:27:01.389838 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:01.389756    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cs86zs_164f6b6e-c466-484f-954c-4fb747df7c6e/istio-proxy/0.log"
Sep 11 13:27:01.895445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:01.895403    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-xnnc6_b5f93de5-d236-4d53-923c-b90a2b96647f/istio-proxy/1.log"
Sep 11 13:27:02.634263 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:02.634215    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-t69l2_53b3a3ad-1213-4413-b56b-f603c91aff5a/main/0.log"
Sep 11 13:27:02.869602 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:02.869572    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-4gh9g_2c674837-0e9d-4450-97a1-ef20da77afa3/main/0.log"
Sep 11 13:27:09.021570 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.021531    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vrzcr/must-gather-6v9dp"]
Sep 11 13:27:09.021997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.021876    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45f9c46-765f-4a63-9c7e-e6132d8da09b" containerName="main"
Sep 11 13:27:09.021997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.021887    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45f9c46-765f-4a63-9c7e-e6132d8da09b" containerName="main"
Sep 11 13:27:09.021997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.021898    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy"
Sep 11 13:27:09.021997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.021904    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6ae420-5c4a-4ea7-aaa7-6c9b51a8df3e" containerName="istio-proxy"
Sep 11 13:27:09.021997 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.021967    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45f9c46-765f-4a63-9c7e-e6132d8da09b" containerName="main"
Sep 11 13:27:09.025022 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.025005    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.028162 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.028138    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrzcr\"/\"kube-root-ca.crt\""
Sep 11 13:27:09.028492 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.028474    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vrzcr\"/\"default-dockercfg-fwnzv\""
Sep 11 13:27:09.029087 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.029072    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrzcr\"/\"openshift-service-ca.crt\""
Sep 11 13:27:09.037195 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.037170    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrzcr/must-gather-6v9dp"]
Sep 11 13:27:09.043853 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.043826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b-must-gather-output\") pod \"must-gather-6v9dp\" (UID: \"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b\") " pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.043981 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.043887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t82nb\" (UniqueName: \"kubernetes.io/projected/d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b-kube-api-access-t82nb\") pod \"must-gather-6v9dp\" (UID: \"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b\") " pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.144561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.144527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b-must-gather-output\") pod \"must-gather-6v9dp\" (UID: \"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b\") " pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.144561 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.144573    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t82nb\" (UniqueName: \"kubernetes.io/projected/d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b-kube-api-access-t82nb\") pod \"must-gather-6v9dp\" (UID: \"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b\") " pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.144980 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.144953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b-must-gather-output\") pod \"must-gather-6v9dp\" (UID: \"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b\") " pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.155874 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.155842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t82nb\" (UniqueName: \"kubernetes.io/projected/d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b-kube-api-access-t82nb\") pod \"must-gather-6v9dp\" (UID: \"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b\") " pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.334196 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.334110    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrzcr/must-gather-6v9dp"
Sep 11 13:27:09.605739 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.605709    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrzcr/must-gather-6v9dp"]
Sep 11 13:27:09.608117 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:27:09.608089    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3fdcb36_ba10_4ac0_bb28_3fa2ce85977b.slice/crio-62e095822612fb7ea132f6ae07a6c9545b11086be158d2fbd2afaaebd87445ce WatchSource:0}: Error finding container 62e095822612fb7ea132f6ae07a6c9545b11086be158d2fbd2afaaebd87445ce: Status 404 returned error can't find the container with id 62e095822612fb7ea132f6ae07a6c9545b11086be158d2fbd2afaaebd87445ce
Sep 11 13:27:09.610074 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.610055    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:27:09.828608 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:09.828575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrzcr/must-gather-6v9dp" event={"ID":"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b","Type":"ContainerStarted","Data":"62e095822612fb7ea132f6ae07a6c9545b11086be158d2fbd2afaaebd87445ce"}
Sep 11 13:27:10.836522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:10.836490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrzcr/must-gather-6v9dp" event={"ID":"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b","Type":"ContainerStarted","Data":"e5abe1729045e8ecda858aff1de6803dadf1078eab96ca3ab3a7da9b0bd1862f"}
Sep 11 13:27:10.836522 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:10.836530    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrzcr/must-gather-6v9dp" event={"ID":"d3fdcb36-ba10-4ac0-bb28-3fa2ce85977b","Type":"ContainerStarted","Data":"d3de317a6fc2fd16ae23a1beeafb1531f2b0b43fdce56e12df32316c90a45cef"}
Sep 11 13:27:10.851301 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:10.851214    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vrzcr/must-gather-6v9dp" podStartSLOduration=1.102596974 podStartE2EDuration="1.851191321s" totalImagesPullingTime="748.594347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:10.851006326 +0000 UTC m=+2395.230532278" watchObservedRunningTime="2026-09-11 13:27:10.851191321 +0000 UTC m=+2395.230717258"
Sep 11 13:27:12.161955 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:12.161909    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-stvxq_2ff9a6d3-53c7-4c74-a2c0-1aa58b2aba71/global-pull-secret-syncer/0.log"
Sep 11 13:27:12.275157 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:12.275131    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rprwc_2b575e23-c420-44fc-8582-1f7ada596cbd/konnectivity-agent/0.log"
Sep 11 13:27:12.332223 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:12.332195    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-247.ec2.internal_5237685c0cfb0624e595569b1a41ac46/haproxy/0.log"
Sep 11 13:27:16.274023 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:16.272668    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:27:16.285339 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:16.284303    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cl228_17138cd4-cf7b-42b4-a15a-5993daf42915/ovn-acl-logging/0.log"
Sep 11 13:27:16.652004 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:16.651968    2572 scope.go:117] "RemoveContainer" containerID="182b01e7749ae8e95be65e6fbe194c305d7a9cd475d09db805c5753bb00a22d6"
Sep 11 13:27:16.918219 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:16.918121    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-9t8p8_51b842ec-53d9-405c-8f6c-f927317249ed/manager/0.log"
Sep 11 13:27:17.237406 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:17.237279    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-5dbbk_5766aadd-5749-4d77-bd13-850382c36559/manager/0.log"
Sep 11 13:27:19.071204 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.071148    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8bbb5c54f-jvr9p_71d0f046-150d-425d-aac7-3119a7d374b1/metrics-server/0.log"
Sep 11 13:27:19.105471 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.105435    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-7kv8g_4236b3a2-1341-41bc-b94e-e556e4dbe9ec/monitoring-plugin/0.log"
Sep 11 13:27:19.234733 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.234699    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgwz2_d4d831b4-e0d3-4241-9d57-234343162b1c/node-exporter/0.log"
Sep 11 13:27:19.263462 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.263438    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgwz2_d4d831b4-e0d3-4241-9d57-234343162b1c/kube-rbac-proxy/0.log"
Sep 11 13:27:19.298451 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.298425    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgwz2_d4d831b4-e0d3-4241-9d57-234343162b1c/init-textfile/0.log"
Sep 11 13:27:19.564137 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.564112    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_158da54a-87cf-4c98-9d6c-b4a788d5a242/prometheus/0.log"
Sep 11 13:27:19.590695 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.590580    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_158da54a-87cf-4c98-9d6c-b4a788d5a242/config-reloader/0.log"
Sep 11 13:27:19.625461 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.625435    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_158da54a-87cf-4c98-9d6c-b4a788d5a242/thanos-sidecar/0.log"
Sep 11 13:27:19.650974 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.650949    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_158da54a-87cf-4c98-9d6c-b4a788d5a242/kube-rbac-proxy-web/0.log"
Sep 11 13:27:19.676201 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.676172    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_158da54a-87cf-4c98-9d6c-b4a788d5a242/kube-rbac-proxy/0.log"
Sep 11 13:27:19.713865 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.713823    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_158da54a-87cf-4c98-9d6c-b4a788d5a242/kube-rbac-proxy-thanos/0.log"
Sep 11 13:27:19.740353 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:19.740277    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_158da54a-87cf-4c98-9d6c-b4a788d5a242/init-config-reloader/0.log"
Sep 11 13:27:22.073298 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.073253    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"]
Sep 11 13:27:22.078723 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.078691    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.086573 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.086519    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"]
Sep 11 13:27:22.189075 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.189029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-podres\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.189458 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.189432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-lib-modules\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.189629 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.189610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-sys\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.189786 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.189768    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf6tp\" (UniqueName: \"kubernetes.io/projected/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-kube-api-access-kf6tp\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.189909 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.189894    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-proc\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.291180 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.291138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf6tp\" (UniqueName: \"kubernetes.io/projected/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-kube-api-access-kf6tp\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.291772 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.291743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-proc\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.291895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.291785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-podres\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.291895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.291853    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-lib-modules\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.291895 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.291857    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-proc\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.292011 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.291979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-sys\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.292011 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.291992    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-lib-modules\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.292118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.292000    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-podres\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.292118 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.292090    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-sys\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.300763 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.300726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf6tp\" (UniqueName: \"kubernetes.io/projected/89a7ac17-3cda-4643-b0ca-ba28344bb1e7-kube-api-access-kf6tp\") pod \"perf-node-gather-daemonset-jjsfk\" (UID: \"89a7ac17-3cda-4643-b0ca-ba28344bb1e7\") " pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.405007 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.404968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.703571 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.703490    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"]
Sep 11 13:27:22.707559 ip-10-0-136-247 kubenswrapper[2572]: W0911 13:27:22.707522    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod89a7ac17_3cda_4643_b0ca_ba28344bb1e7.slice/crio-f7a1c48dcc83dd1f985ea367f82c4afc8ead906f2ca0b15a0bae01def0e79437 WatchSource:0}: Error finding container f7a1c48dcc83dd1f985ea367f82c4afc8ead906f2ca0b15a0bae01def0e79437: Status 404 returned error can't find the container with id f7a1c48dcc83dd1f985ea367f82c4afc8ead906f2ca0b15a0bae01def0e79437
Sep 11 13:27:22.785110 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.785066    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-kk6zt_e012d3d5-8838-4243-a364-3f664f0835f7/download-server/0.log"
Sep 11 13:27:22.918264 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.918229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk" event={"ID":"89a7ac17-3cda-4643-b0ca-ba28344bb1e7","Type":"ContainerStarted","Data":"edb2c14b5ade5424f6013b100b4b5143b43607b248ebb5d5d5106038d6f193f9"}
Sep 11 13:27:22.918509 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.918283    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk" event={"ID":"89a7ac17-3cda-4643-b0ca-ba28344bb1e7","Type":"ContainerStarted","Data":"f7a1c48dcc83dd1f985ea367f82c4afc8ead906f2ca0b15a0bae01def0e79437"}
Sep 11 13:27:22.918509 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.918310    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:22.935685 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:22.935626    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk" podStartSLOduration=0.935602829 podStartE2EDuration="935.602829ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:22.933299942 +0000 UTC m=+2407.312825879" watchObservedRunningTime="2026-09-11 13:27:22.935602829 +0000 UTC m=+2407.315128766"
Sep 11 13:27:24.790909 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:24.790882    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wcmgr_a403e860-0e0a-4068-bbf7-e9eec044085e/dns/0.log"
Sep 11 13:27:24.814425 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:24.814390    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wcmgr_a403e860-0e0a-4068-bbf7-e9eec044085e/kube-rbac-proxy/0.log"
Sep 11 13:27:24.868333 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:24.868283    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sw2tq_73599d33-dd5d-449d-9d91-d2f315faa922/dns-node-resolver/0.log"
Sep 11 13:27:25.521445 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:25.521401    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w74bf_be1e7525-a81d-417f-ae9c-2511993d3d86/node-ca/0.log"
Sep 11 13:27:26.611858 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:26.611816    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cs86zs_164f6b6e-c466-484f-954c-4fb747df7c6e/istio-proxy/0.log"
Sep 11 13:27:26.948775 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:26.948748    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-xnnc6_b5f93de5-d236-4d53-923c-b90a2b96647f/istio-proxy/0.log"
Sep 11 13:27:26.960114 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:26.960074    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-xnnc6_b5f93de5-d236-4d53-923c-b90a2b96647f/istio-proxy/1.log"
Sep 11 13:27:27.970116 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:27.970072    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kz47p_26c0e0cc-5996-4060-aa28-d24a536e799f/serve-healthcheck-canary/0.log"
Sep 11 13:27:28.629270 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:28.629234    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6t94l_a1aea23f-19ba-4872-b2f2-ca158db6e92c/kube-rbac-proxy/0.log"
Sep 11 13:27:28.649923 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:28.649893    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6t94l_a1aea23f-19ba-4872-b2f2-ca158db6e92c/exporter/0.log"
Sep 11 13:27:28.671061 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:28.671016    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6t94l_a1aea23f-19ba-4872-b2f2-ca158db6e92c/extractor/0.log"
Sep 11 13:27:28.935260 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:28.935220    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vrzcr/perf-node-gather-daemonset-jjsfk"
Sep 11 13:27:31.280991 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:31.280963    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-grzwd_b69e3466-801b-439e-9141-2ba086a73d51/manager/0.log"
Sep 11 13:27:31.583305 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:31.583279    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wssvg_edab90c5-2bb5-4f2e-a45b-ef22ae1f3cc4/server/0.log"
Sep 11 13:27:31.900137 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:31.900093    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-zh98f_c58533ed-29e8-4fd8-8fcf-b8c841556f1d/manager/0.log"
Sep 11 13:27:31.924751 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:31.924719    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbb4999dc-zh98f_c58533ed-29e8-4fd8-8fcf-b8c841556f1d/copy-manifests/0.log"
Sep 11 13:27:33.130741 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:33.130702    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cs86zs_164f6b6e-c466-484f-954c-4fb747df7c6e/istio-proxy/0.log"
Sep 11 13:27:33.330126 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:33.330084    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5655dcc49-d7gpb_47714c3d-6a85-42bf-be66-632c87b7473f/manager/0.log"
Sep 11 13:27:33.408185 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:33.408112    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-xnnc6_b5f93de5-d236-4d53-923c-b90a2b96647f/istio-proxy/0.log"
Sep 11 13:27:33.417035 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:33.417003    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-xnnc6_b5f93de5-d236-4d53-923c-b90a2b96647f/istio-proxy/1.log"
Sep 11 13:27:34.989241 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:34.989212    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cs86zs_164f6b6e-c466-484f-954c-4fb747df7c6e/istio-proxy/0.log"
Sep 11 13:27:35.279365 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:35.279268    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-xnnc6_b5f93de5-d236-4d53-923c-b90a2b96647f/istio-proxy/0.log"
Sep 11 13:27:35.290678 ip-10-0-136-247 kubenswrapper[2572]: I0911 13:27:35.290644    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-xnnc6_b5f93de5-d236-4d53-923c-b90a2b96647f/istio-proxy/1.log"